BDWAI London Conference 2023

Subpage Hero

Subpage Hero

      

Loading

Git For Data - DataOps best practices at scale

08 Mar 2023
Data Strategy & Decision Intelligence

Concepts such as Dev/Test environments and CI/CD are harder to implement in data engineering, since the data, and not just the code, should be managed.

In this session, we will review ways to achieve version control over the data lake, with lakeFS, using git-like semantics to create and access those versions.

Introducing known concepts from code, such as ״branch ״ to create an isolated version of the data, ״commit ״, to create a reproducible point it time, and “merge” in order to incorporate your changes in one atomic action.

We will review real life examples of how lakeFS customers use these concepts to reduce their cloud storage cost, increase their data engineering efficiency and achieve millisecond recoveries from data outages.

The session will include a live demo - from nothing to complete data lake versioning in 15 minutes or less.

Speakers
Iddo Avneri, VP, Customer Success - Treeverse, the lakeFS creators

Partners

Media Partner

  • DataFloq
  • AI TIME JOURNAL
  • Enterprise Security Magazine
  • Urban Big Data Centre

 

Media Partner

  • Lynchpin Media
  • Packt
  • HFT Corporate

 

Media Partner

  • CIO Applications Europe
  • Computing Magazines UK
  • CEO Media Group
  • AISB

 

Media Partner

  • ExCeL
  • EM360
  • FAMN

 

Media Partner

  • DAScA
  • TechTarget
  • Office for AI
  • Elite Business
  • Top Business Tech

 

Media Partner

  • AI Magazine
  • DevDiscourse

 

2023 Sponsors

Headline Sponsor


 

Platinum Sponsors


Gold Sponsors


Silver Sponsors


Theatre Sponsors


VIP Lounge Sponsors


Newsletter Sign Up


By submitting this form you agree to our privacy policy and consent to receiving communications, you may opt out at any time.