can arel

Sweden

@can_arel

Badges

Problem Solving
Python
Sql

Certifications

can_arel has not earned any certificates yet.

Work Experience

  • Contract Data Engineer

    Ericsson•  April 2019 - December 2020

    Building data pipelines on Mesosphere DC/OS with Kafka, Docker, Nifi, Elasticsearch and CockroachDB for next generation analytics of testing logs. Writing modules and scripting in python. DC/OS devops and maintainance. Member of data government council.

  • Contract Data Engineer

    Tele2•  January 2018 - March 2019

    Elasticsearch operations and integration of Tele2 logs from different systems. Machine Learning with Elasticsearch. Data discovery and analysis for Fraud Detection.

  • Contract Developer

    ROOM328•  August 2017 - December 2017

    Dockerisation of existing application. Migration of application to ECS on AWS. Batch query analytics in Hadoop and Spark.

  • Contract Data Engineer

    Bonnier Tidskrifter•  April 2017 - August 2017

    Migration of existing Hadoop platform from dedicated servers to Open Stack cloud solution. Install and configure front ends. Install and configure Hadoop cluster. Test and verify migration success. Set up Mysql replication.

  • Data Engineer

    DeltaProjects•  November 2015 - March 2017

    Big Data and predictive modeling Reimplemented existing Machine Learning classifiers in Apache Spark on HortonWorks cluster focusing on accuracy improvement and scaling design. Job scheduling with Airflow. Third party data selection and evaluation. Developed new Machine Learning Classifiers in Apache Spark. Customer specific analysis and job scheduling in Apache Spark. Optimization of MapReduce Batch jobs. (Pig jobs to Spark) Hadoop storage design.(Protocol buffers and Parquet)

  • Software Engineer

    Adtoox•  May 2014 - August 2015

    Ground up Big Data implementation Implemented a Big Data system in HortonWorks for large batch processing jobs that were running on a daily/hourly basis. The logs were transferred using Apache Flume and Apache Hive was used for data storage and processing engine. Wrote custom Hive queries using HiveQueryLanguage. Custom scripts in Bash and Python for improving automation of Big Data workflows.

  • Software Engineer

    Campanja•  November 2011 - December 2013

    BigData jobs, product development and server design. Design and implementation of Big Data solution and scaling of servers for data collection. MapReduce jobs that were deployed to Elastic Map Reduce using Cascading as framework in MapReduce first generation. Wrote a product parser for large-scale automation of SEM longtail keyword campaigns in Erlang.

Education

can_arel has not updated education details yet.

Links

can_arel has not updated links details yet.

Skills

can_arel has not updated skills details yet.