Lakehouse Information Stack with Raj Bains

Initially printed on April 12, 2022.

As corporations transfer to Spark and a Lakehouse structure, they’re realizing that the info instruments are lagging means behind.  It’s essential to be a programmer to successfully use Spark and Airflow.

There are some low-code ETL instruments, however is that sufficient?  Corporations wish to deal with their information pipelines like mission-critical apps.  They need DevOps for information, with GIT, check protection, and CI/CD.  As well as, corporations want end-to-end visibility of their information pipelines, together with monitoring, metadata, and column-level lineage.

The place are the info instruments for these capabilities and the way do non-programmers use these?  

In as we speak’s podcast, you’ll see how Prophecy’s low-code information engineering platform, constructed on Spark and Airflow, supplies an entire answer for creating, deploying, and monitoring information pipelines.  We’ll converse with Raj Bains, who’s the founder & CEO of Prophecy.  

Raj has spent 20 years constructing highly effective instruments – Microsoft Visible Studio, founding engineer for CUDA at NVIDIA, product supervisor for Hive at Hortonworks. He’s obsessed with making all organizations productive with information and making the lives of information engineers higher by lowering toil and rising the enjoyment.

Additionally, in case you like what you hear, Prophecy has a particular provide for our listeners.  Go to Prophecy.IO/request-a-demo and put in “SED” for the referral code.  When you determine to buy inside 3 months of the demo, you get 10% off.  If you buy after 3 months, you continue to get 5% off.

Sponsorship inquiries: [email protected]




Transcript offered by We Edit Podcasts. Software program Engineering Day by day listeners can go to to get 15% off the primary three months of audio enhancing and transcription providers with code: SED. Due to We Edit Podcasts for partnering with SE Day by day. Please click on right here to view this present’s transcript.

Similar Posts

Leave a Reply

Your email address will not be published.