Posts tagged ‘Kaltura DWH’

April 22nd, 2012

Schema Management Under Source Control

by Omer Gertel

Deploying new features that require changes to the database is a technical challenge in any application. To quote Jeff Atwood from Coding Horror: “When I ask development teams whether their database is under version control, I usually get blank stares.”

The database is a critical part of your application. If you deploy version 2.0 of your application against version 1.0 of your database, what do you get? A broken application. And that’s why your database should always be under source control right next to your application code. You deploy the app, and you deploy the database. Like peanut butter and chocolate, they are two great tastes that taste great together.

 

The Database Is Under Source Control

At Kaltura, we have kept the schema definition scripts under source control for a while. This allows you to checkout the latest Kaltura Community Edition, and install a new working server easily. Terrific! Enjoy your new Kaltura deployment.

But what can you do if you already have an existing Kaltura server running? How can we help you get the new and exciting features added to the latest Kaltura version? Upgrading to the latest version of the code and the database is not enough. We also need to migrate your existing data to the new version, change configuration files and even update 3rd party softwares we are using in the server.

In Eagle we created an update script that runs all SQL and PHP updates on the server and all SQL updates on our Kaltura Data Warehouse (DWH), which is a good start for our future upgrade process.

Our upgrade script needs to know which version of schema is already installed, and then understand and automatically apply the updates to the schema. Luckily, it does. As part of the Kaltura development cycle we deploy features to a variety of servers all the time. To deploy a feature to QA, integration, and finally into our SaaS offering, as easy as possible, we developed a method that allows us to automatically update a server to a newer version of Kaltura, and you get to benefit from this as well.
read more »

November 30th, 2011

Adventures With Open Source ETL

by Omer Gertel

One of the greatest benefits I get from working at Kaltura, is the opportunity to work with  some of the greatest open source projects out there. I’ve written about Kaltura’s data warehouse (DWH), powering the entire analytics side of Kaltura’s products and services, and I promised I’d go into more details about the technology that makes the data crunching engine turn.

read more »

August 25th, 2011

Data Makes The World Go Round

by Omer Gertel

Behind the scenes in the Kaltura Server, a lot of data is being created. This data is collected and aggregated into Kaltura’s Data Warehouse  (DWH). The DWH contains all the information displayed in the  Analytics tab in the Kaltura Management Console (KMC), and more (some accessible through the API, and some only through direct querying). In this post I’ll shortly describe what data is stored in the DWH and how to get to it. In future posts I’ll dive into the technology powering the DWH, because it is different from the technology powering the rest of the Kaltura Server.

read more »