Big Data Developer İş İlanı
İşveren Hakkında
- İstanbul(Avr.)(Zeytinburnu)
- Bilişim Teknoloji Hizmetleri
GENEL NİTELİKLER
We are looking for a teammate with the following qualifications to work at Piri Medya A.Ş. our company operating within the Albayrak Group and managing digital broadcasting projects;
- Person will be responsible to Perform Big Data Administration and Engineering activities on multiple Kafka, Hbase and Spark clusters,
- Work on Performance Tuning and Increase Operational efficiency on a continuous basis,
- Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements,
- work on key deliverables ensuring production scalability and stability,
- Responsible for Big Data Production environment which includes Hadoop (HDFS and YARN), Hive, Spark, Livy, SOLR, Oozie, Kafka, Airflow, Nifi, Hbase etc,
- Perform optimization, debugging and capacity planning of a Big Data cluster,
- Perform security remediation, automation and self heal as per the requirement,
- Significant prior experience in designing and building highly scalable and reliable data pipelines using BigData services (EMR, Python, Airflow),
- Software development experience with proficiency in Python and Go,
- Large scale design, implementation and operations of data storage technologies such as Kubernetes,
We are looking for a teammate with the following qualifications.
- Graduated from computer engineering, electrical and electronic engineering, mathematical engineering, physics, statistics, econometrics,
- Minimum 5-6 years of work experience in maintaining, optimization, issue resolution of Big Data large scale clusters, supporting Business users and Batch process,
- Hands-on Experience No SQL Databases HBASE, DuckDB, QuestDB is plus,
- Prior Experience in Linux / Unix OS Services, Administration, Shell, Go services for Kubernetes and Airflow, awk scripting is a plus,
- Experience querying massive datasets using Spark, Presto, Hive, Impala, etc,
- Experience with designing and implementing real-time pipelines,
- Experience with data quality and validation,
We are looking for a “Big Data Developer”.
