About
I am a Software Engineer have a good experience in Data Engineering. I enjoy problem-solving
and coding. Always strive to bring 100% to the work I do.
I have worked on programming languages and technologies like Python, SQL, MySQL, Design
Databases, Data Warehousing, AWS, GCP, Apache Spark, Apache Airflow, Apache Hadoop, Java, C++.
I have 4+ years of professional work experience which helped me strengthen my experience in Data
Engineering.
I'm passionate about developing complex applications that solve real-world problems impacting
millions of users.
- Languages: Python, Java, C++, SQL, Dart
- Databases: MySQL
- Libraries: NumPy, Pandas, PySpark, Spark SQL
- Frameworks: Django REST, Flutter
- Tools & Technologies: Git, ETL, AWS, GCP
- Others: Apache Spark, Apache Hadoop, Apache Airflow
- I meet people every day, making new friends, learn something new, expand my network.
- I'm passionate in building and developing solutions make people life easier.
- I started my own startup 'Cipple', which aim to provide software solutions.
Experience
- Supervising three huge major internal Police HQ projects.
- Working with Oracle SQL databases.
- Working with the backend team, using Spring Boot, to provide support services, maintenance, and implement system updates.
- Partnering with the database team for deployment activities.
- Regularly meetings with Police clients to gather new requirements for system updates.
- Tools: Java, Design Databases, Spring Boot, Jira, Product Management, Oracle, SQL.
- Proficient in end-to-end data engineering solutions: data ingestion, transformation, storage, and analysis,
- Good in ETL processes: cleansing, transforming, and integrating diverse data sources.
- Strong knowledge of ETL, Linux, Data warehousing, Google Cloud Storage (GCS), Google Compute Engine (GCE) storage systems, BigQuery, CLI, S3, Redshift, Lambda, Athena, Glue, Hadoop, Spark, and Python.
- Good skills in Airflow for workflow automation with intermediate Databricks and Spark experience.
- Passionate about Big Data architectural design, with project implementation and quality review experience.
- Tools: Python, Django REST, Design Databases, Data Warehousing, ETL, Data Pipelines, SQL, MySQL, AWS, GCP, Apache Spark, Apache Hadoop, Apache Airflow.
- Developing Mobile Application using Flutter, that solves a huge electricity problem in city of Tulkarm in state of Palestine.
- The application is available for Android, iOS, Windows, and website.
- Smart calculator that calculates the consumption of used devices, displays consumption reports and sends smart alerts.
- Smart notification system that works at peak times.
- User-friendly design.
- Responsive application.
- Google Map API is used to detect user location and show the nearest charging center details and position.
- Compatible with People with disability.
- Tools: Flutter, Postman, NodeJS, MongoDB, SendGrid.
Projects
Designed a data architecture for processing 1PB of weather sensor data.
- Tools & Technologies: GCP, BigQuery, Apache Airflow, Python, AWS S3, Redshift, ETL
- GCS implementation: Designed a data architecture for processing 1PB of weather sensor data, leveraging GCP's BigQuery for analytics, Apache Airflow for orchestration, and optimizing data storage and compression strategies to meet performance and cost objectives.
- AWS implementation: Cloud Infrastructure Knowledge: The solution demonstrates a solid understanding of cloud services, with AWS S3 and Redshift chose based on their suitability for structured data storage and analytics.
- ETL Design: existing data format, transformation needs, and loading into a cloud environment.
- Database Design: choosing a star schema for efficient analytics and utilizing partitions to enhance query performance.
- Cost Estimation: breaks down costs associated with data transfer, storage, and compute.
- Performance Optimization: Performance depends on CPU allocation per user and query time estimation.
- Project Management: provides a clear breakdown of team members, their roles, and the various aspects of the project. This shows an understanding of collaborative project management.
- Problem-Solving: The solution identifies trade-offs between Redshift Spectrum vs. native Redshift.
- Cost-Performance Trade-offs: The solution strikes a balance between performance and cost.
- Overall, the project and solution showcase a comprehensive understanding of cloud-based data management, ETL processes, database design, cost analysis, and practical implementation considerations.
processing sales data, making it query-ready for analysts.
- Tools & technologies: AWS S3, Apache Spark, AWS Glue, Amazon Athena, Amazon Web Services (AWS)
- AWS EMR Cluster: I established a scalable EMR cluster with Spark and Zeppelin, ensuring secure access via an EC2 key pair.
- S3 Data Storage: Data was structured within Amazon S3, separating raw and processed data.
- PySpark Job: Using PySpark, I transformed data by replacing spaces in column names with underscores, facilitating SQL queries.
- Data Validation: I ensured data quality, permitting only clean data into the output S3 folder.
- Athena Integration: AWS Athena enabled SQL querying of the cleansed data after Glue Crawler created a Data Catalog table.
- Data Insights: I ran queries, including forecasting revenue by region and segment, for strategic decision-making.
Designed and executed a serverless data pipeline on Amazon Web Services (AWS) to ingest, process, and store CSV data efficiently.
- Tools & technologies: AWS Lambda, AWS S3, Amazon Web Services (AWS)
- Creation of two S3 buckets—one for raw data and another for processed data—laying the foundation for seamless data flow.
- Development of a Lambda function for data processing, ensuring efficient and cost-effective data transformations.
- Implementation of an S3 event notification system, automating the data pipeline by triggering Lambda functions upon new file uploads.
- Utilization of AWS CloudWatch for real-time monitoring and logging, guaranteeing the pipeline's reliability.
Smartphone application and a website, It was completed under the supervision of the German Cooperation Organization (GIZ) with An-Najah National University to solve problems related to the municipalities (this work was implemented with the Tulkarm Municipality), and aims to solve the electricity problem in the city of Tulkarm by rationalizing consumption in addition to a smart notification system that works automatically in rush hours.
- Tools & technologies: Flutter (Front-end), NodeJS(Back-end), Postman, SendGrid, Firebase (Notifications), Google Map API, MongoDB.
- Smartphone application and a website, It was completed under the supervision of the German Cooperation Organization (GIZ) with An-Najah National University
- Solves problems related to the municipalities (this work was implemented with the Tulkarm Municipality)
- Aims to solve the electricity problem in the city of Tulkarm by rationalizing consumption in addition to a smart notification system that works automatically in rush hours.
Education
Nablus, Palestine
Degree: Bachelor degree, Computer Engineering
- Software Engineering
- Data Structures and Algorithms
- Object Oriented Programming
- Databases
- Web Development
- Networks and Information Security
- Digital Systems Design
- Artificial Intelligence
Relevant Courseworks:
Skills
Languages and Databases
Libraries
Frameworks
Other
Certifications
Volunteering
Ministry of Telecom & IT Palestine
- Python Bootcamp in MTIT of Palestine. Teach +70 students the basics of programming in addition to the critical and logical thinking.
Details:
IEEE An-Najah Student Branch
- Local and international competitions, technology exhibitions.
Details:
An Najah National University
- SDG's posters design for An-Najah National University.
Details:
Engineers Without Borders UK
- Educational tours, technology courses, science and engineering exhibitions.
Details:
Awards
WSA National Nominee 2022 Winner!
WSA
- One of top 20 smart digital solutions out of 500 solutions worldwide, with the participation of 170 countries in the United Nations. A smart application that solves the electricity problem in the city of Tulkarm.
Details:
Firefox dark funnel campaign Winner!
Mozilla Firefox
- The 1st winner in Firefox dark funnel campaign at An-Najah National University.
Details: