Vilnius
Big Data Engineer
Your main task will be:
- Ensure data quality and integrity through data governance best practices, including validation, transformation, and security protocols, using technologies such as PySpark, Impala, Hive, HDFS, ClickHouse, Zabbix, and Airflow.
- Work closely with business and technology representatives to gather functional and technical requirements.
- Contribute to engineering best practices, standards, and architectural approaches within the data ecosystem.
- Collaborate with the project management team to develop the overall implementation solution plan and actively contribute to project life cycle phases, leveraging technologies like PySpark and Airflow.
- Stay updated on the latest technology trends, particularly in the areas of data platforms, focusing on technologies such as PySpark, Impala, Hive, HDFS, ClickHouse, and Zabbix.
- Continuously monitor and improve the performance of data systems to ensure they are optimized for speed, reliability, and scalability, utilizing technologies like PySpark and HDFS.
Job Requirements
- 3+ years of data engineering or similar technical experience.
- Knowledge of SQL, Data modelling architecture and ETL processes with tools such as Apache Airflow.
- Experience with AWS, AI and NiFi is a plus.
- Proficiency in PySpark, Python, Linux, HDFS, Elasticsearch, ClickHouse, and various SQL databases.
- Experience with AWS and NiFi is a plus.
- Knowledge of SQL and ETL processes with tools such as Apache Airflow.
- Strong analytical and problem-solving skills.
- Experience with version control systems like Git.
- Understanding of data quality assurance and governance best practices.
- Willingness to learn and adapt to new technologies and industry trends in data engineering.
As part of our client team You:
- Have freedom to implement best ideas
- Be a part of an inspiring working culture that values high standards
- Be an owner of your flexible working hours and results
- Have FUN at team building activities and workshops
- Personal phone with unlimited calls, sms and internet, mobile portable internet, Go3 TV on your phone and TV
- Additional health and accident insurances, accumulation of tier III pensions
- Benefit from other motivational perks such as healthy snacks and fruits, coffee, team lunches and much more!
Gross salary 2000-7000 EUR/month