DQLab UMN x Databoks.id: Getting to Know the Daily Life of Data Engineers in the Media Industry

Tangerang – A career in the data industry is now a promising dream, especially in the digital era– a Data Engineer is one of them. A Data Engineer is a professional data practitioner who designs data management and helps the company’s agency infrastructure. DQLab, in collaboration with Databoks.id, held a Live Webinar online on March 3, 2022. This webinar invited speaker Yogi Yulianto, a Data Engineer at Databoks.id, who is also the presenter of the webinar material themed “Life as Data Engineer at The Media Industry.”

Yogi started the webinar session by first introducing the Media Industry. He revealed that the media industry is one of the economic sectors comprising companies that produce and distribute content such as television, music, publishing, advertising, and other industries. 

Furthermore, Yogi began to enter the second topic, namely explaining Data Engineer in the Media Industry. He revealed that Data Engineering is a series of processes that involve designing, collecting, storing, processing, and analyzing large amounts of data widely. 

“It’s a field that involves developing and maintaining large data processing systems to prepare data to be available and usable, which in turn can make data-driven business decisions,” Yogi said.

Yogi explained that Data Engineering is the intersection of math, statistics, algorithms, and software engineering. In their work, Data Engineers will collect, move/store data, and finally explore data or data transformation such as data cleaning, anomaly detection, and prep. 

“Nowadays, new technologies such as ChatGPT are really interesting, so if you want to have a career in the data field, you definitely need a Data Engineer first. Because indeed Data Engineers are quite needed in several companies,” he said.

After explaining and introducing the Data Engineer profession, Yogi then provided the skills needed to become a Data Engineer, which are Data Management (MySQL/Cassandra/Postgre), Programming Languages, Cloud Technology, Distributed computing frameworks, Shell, and ETL Framework.

Yogi also explained some of the technology components commonly used by Data Engineer practitioners at Databoks.id in their daily lives, such as the Python programming language, Flask Framework, MySQL for data storage, Excel, and workflow scheduler using APS Scheduler.

“So, for the daily tasks of the Data Engineer himself, the first is to create, maintain and monitor this ETL process, then support data analysts for scraping and cleaning data. Then we also research to create NLP models such as summarization, keyword extractor, sentiment analysis, and others. But the ETL Process is the task primarily conducted because it is produced every day and the article content is currently more than 200 articles per week,” Yogi added.

Data Engineer in the digital era is a profession that is needed for various lines of industry. This is because the Data Engineer’s job is very specific and helps other professional data practitioners (such as Data Analysts or Data Scientists) prepare data. Start learning at DQLab.id to develop Data Engineering knowledge and skills. 

By DQLab

English translation by Levina Chrestella Theodora

Kuliah di Jakarta untuk jurusan program studi Informatika| Sistem Informasi | Teknik Komputer | Teknik Elektro | Teknik Fisika | Akuntansi | Manajemen| Komunikasi Strategis | Jurnalistik | Desain Komunikasi Visual | Film dan Animasi | Arsitektur | D3 Perhotelan , di Universitas Multimedia Nusantara. www.umn.ac.id