Beam Enrich (which already existed as an independant asset for a couple of months).We’re creating the following new repositories for our subprojects:
TYCHO MAGNETIC ANOMALY 2 ARCHIVE
We also would like to use this as a next step in our batch pipeline deprecation process and archive the following components: We expect this change will make development even more OSS-friendly and easier to contribute to.
TYCHO MAGNETIC ANOMALY 2 CODE
In order to solve that problem we’ve made a decision to split the Snowplow monorepository into individual repositories, each containing code for a single application. However, as Snowplow’s OSS estate was growing, we started to realise that it’s getting harder to maintain this guarantee and that the monorepository approach makes our development process very inflexible as we sometimes had to do an umbrella release and a blog post just for an urgent hot fix. One of the goals of these big bang releases was a compatibility guarantee, which meant that all assets within a single release are compatible with each other. Almost every month we then would do a big bang release with all assets and an associated blog post. This repository holds the whole history of changes back to inception in 2012. Historically, most of Snowplow’s Open Source estate was hosted by a single GitHub monorepository. Hence the Event Recovery job 0.2.0 will be announced soon, which leverages all benefits of the new format. In order to make R119 production-ready we also wanted to make sure that new functionality related to bad rows is on feature-parity (or above) with the legacy format.
Enrich process could crash with NullPointerException in case of empty query parameter in IgluAdapter ( #4330).Events from a POST payload could get lost if the payload contained at least one corrupted event ( #4320).We identified several bugs in R118 that are related to changes we’ve made there: We, our open source community and customers extensively tested all assets from R118 and now we’re excited to announce that R119 marks general availability of the new format and all associated functionality. We announced R118 as a public beta, given the big changes we made in that release. For more information on understanding failed events see our documentation here. This significantly improves the experience of diagnosing what is causing the failures. In Snowplow R118 Morgantina we introduced a new format for failed events (bad rows), bringing a much more structured approach for events that fail at any step of the pipeline. Production release of the new failed events format Production release of the new failed events formatġ.Read on to learn more about Snowplow R119 Tycho Magnetic Anomaly Two, named after the powerful Space Odyssey monolithic artefact that breaks itself into smaller objects. We’ve also significantly increased the level of test coverage across the different services. It marks the production ready release of a new bad rows (failed events) format and becomes the last umbrella release in the history of this project. This release is about as big as they come, as it is an important milestone for the Snowplow pipeline. We are thrilled to release Snowplow R119 Tycho Magnetic Anomaly Two.
0 kommentar(er)
