BDWAI London Conference 2023

Subpage Hero

Subpage Hero



Git For Data - DataOps best practices at scale

08 Mar 2023
Data Strategy & Decision Intelligence

Concepts such as Dev/Test environments and CI/CD are harder to implement in data engineering, since the data, and not just the code, should be managed.

In this session, we will review ways to achieve version control over the data lake, with lakeFS, using git-like semantics to create and access those versions.

Introducing known concepts from code, such as ״branch ״ to create an isolated version of the data, ״commit ״, to create a reproducible point it time, and “merge” in order to incorporate your changes in one atomic action.

We will review real life examples of how lakeFS customers use these concepts to reduce their cloud storage cost, increase their data engineering efficiency and achieve millisecond recoveries from data outages.

The session will include a live demo - from nothing to complete data lake versioning in 15 minutes or less.

Iddo Avneri, VP, Customer Success - Treeverse, the lakeFS creators


Media Partner

  • DataFloq
  • Enterprise Security Magazine
  • Urban Big Data Centre


Media Partner

  • Lynchpin Media
  • Packt
  • HFT Corporate


Media Partner

  • CIO Applications Europe
  • Computing Magazines UK
  • CEO Media Group
  • AISB


Media Partner

  • ExCeL
  • EM360
  • FAMN


Media Partner

  • DAScA
  • TechTarget
  • Office for AI
  • Elite Business
  • Top Business Tech


Media Partner

  • AI Magazine
  • DevDiscourse


2023 Sponsors

Headline Sponsor


Platinum Sponsors

Gold Sponsors

Silver Sponsors

Theatre Sponsors

VIP Lounge Sponsors

Newsletter Sign Up

By submitting this form you agree to our privacy policy and consent to receiving communications, you may opt out at any time.