DZone.com Feed

---

• Kafka on Kubernetes, the Strimzi Way (Part 3)
• Types of Matplotlib in Python
• Migration of Java-Based Web Applications From Commercial to Open Source Software
• Managing Data in the Lakehouse
• AR and VR Trends: Differences Between Developers and Non-Developers — Part Two
• How to Make Chatbots More Intelligent With Contextual Intelligence
• C++ RESTful Web Service With Swagger-UI and Auto-Documented Endpoints
• DevOps: Release Fast With Artifactory
• How to Create a Jenkins Declarative Pipeline
• Promoting APIs and API Implementations to Higher Environments
• MicroProfile Config With etcd
• RESTful API Design Driven Approach
• Optimizing a Simple Ray-Tracer Written in Go Part 2
• CircleCI vs Jenkins: Choosing The Right CI/CD Tool
• Swift Package Manager, Part 1: Introduction to Swift Package Manager
• Working of Package Manager in Linux
• Get More Transparency on Your Microservices API With OpenAPI
• How to Use Protobuf With Apache Kafka and Schema Registry
• Cybersecurity Technologies You Should Be Aware of in 2020
• Kustomize Your Kubernetes Deployments
• Design, Develop, Deploy and Manage a RESTful Application With MuleSoft
• Jenkins Pipeline Groovy script - Part 2 Add a User to a Gitlab Group
• Jbang - The Power of Shell Scripting for Java
• Local Kubernetes Testing With KIND
• Personal Mini Toolchains
• How to Exercise the 5 Scrum Values on Your Scrum Team
• Securing gRPC Microservices With Istio Service Mesh
• Setting Up an MVC Core 3.1 Application With an Empty Template
• AWS EKS: Fine-Grained IAM Roles for Service Accounts (IRSA)
• gRPC Basics

Kafka on Kubernetes, the Strimzi Way (Part 3) Posted: 03 Aug 2020 09:04 PM PDT Over the course of the first two parts of this blog series, we setup a single-node Kafka cluster on Kubernetes, secured it using TLS encryption and accessed the broker using both internal and external clients. Let's keep iterating! In this post, we will continue the Kafka on Kubernetes journey with Strimzi and cover: How to apply different authentication types: TLS and SASL SCRAM-SHA-512 Use Strimzi Entity operator to manage Kafka users and topics How to configure Kafka CLI and Go client applications to securely connect to the Kafka cluster The code is available on GitHub - https://github.com/abhirockzz/kafka-kubernetes-strimzi/

Types of Matplotlib in Python Posted: 03 Aug 2020 08:06 PM PDT The data visualizations are the graphical representation of data which produces the images to map the relationships among the data values. There are many visualization tools in the market which can generate automated charts or graphs by collecting the data from various sources. Python is a very simple programming language which is widely used in the market for carrying the data science work to meet the business needs. Python has got its own packages for displaying the charts or graphs. Matplotlib in Python is a package that is used for displaying the 2D graphics. The Matplotlib can be used in python scripts, shell, web application servers and other GUI toolkits. Python provides different types of plots such as Bar Graph, Histogram, Scatterplot, Area plot, Pie plot for viewing the data. Let us now discuss these types of Matplotlib in detail.

Migration of Java-Based Web Applications From Commercial to Open Source Software Posted: 03 Aug 2020 07:37 PM PDT Business owners need the software as commercial software and open-source software to use in their projects. Organizations are using only commercial software for the last five decades of their software development activities. For the past ten years, the Open Source software usage is increasing day by day in projects due to their advantages like cost, code access, reliability, and natural development. There is a paradigm shift now in enterprises from commercial to open source tools for overall productivity gains and better Total Cost of Ownership (TCO). A recent survey by Tidelift found that 92% of application libraries contain open source components. Open-source Security and Risk Analysis Report from Synopsys survey clearly says that the growth in Open Source components in their projects increasing rapidly.

Managing Data in the Lakehouse Posted: 03 Aug 2020 01:58 PM PDT Introduction to Data Lakehouse "Data Lakehouse" is a new architecture paradigm in the data management space that combines the best characteristics of Data Warehouse and Data Lakes. Once you load the data into a data lake, there is no need to load the data into a warehouse for additional analysis or business intelligence. You can directly query the data residing in cheaper but highly reliable storage, often termed as "Object Stores", thus reducing the operational overhead on data pipelines. Key Features of a Data Lakehouse At a high-level, a Data Lakehouse has the following characteristics –

AR and VR Trends: Differences Between Developers and Non-Developers — Part Two Posted: 03 Aug 2020 01:43 PM PDT We continue to look into some of the trends in the AR and VR ecosystem, focusing on the main differences between developers and non-developers active in this space. You can view our first part of this article here. 22% of AR/VR Non-Developers Are Learning to Code 15% of people involved in AR and VR as non-developers have zero knowledge of how to code, whereas 17% are actively coding to get things done. There is a large range of skills, but the biggest group here are those that are actively trying to build on their coding skills, with 22% of AR/ VR non-developers doing so. This indicates that no-code tools, whilst useful for getting things done, don't cover the needs of more than 1 in 5 AR and VR practitioners who are subsequently learning to code to overcome these limitations.

How to Make Chatbots More Intelligent With Contextual Intelligence Posted: 03 Aug 2020 01:40 PM PDT Chatbots need to have contextual awareness if they have to adequately resolve a query. This contextual awareness leads to intelligence over time, by handling millions of queries over significant periods. Conversational UX relies on effective contextual intelligence to create more meaningful relationships with customers. From banking to health services, each industry has unique requirements from contextual chatbots that work with large data sets.  Designing a Contextual Chatbot Designing a contextual chatbot requires strategically planning out key characteristics and use-cases for the technology. This includes any critical data points that it needs to analyze first, as well as any customer-based interactions it can start having early on. When designing the right chatbot, embedding contextual analysis is important from the get-go.

C++ RESTful Web Service With Swagger-UI and Auto-Documented Endpoints Posted: 03 Aug 2020 01:29 PM PDT This is a 5 minutes tutorial how-to-use Oat++ web framework to build your own C++ performant web-service and integrate it with Swagger-UI. Pre Requirements For Mac/Linux: Git, build-essentials, CMake. For Windows: Git, CMake, MSVC. Install Oat++ Clone oatpp repo:

DevOps: Release Fast With Artifactory Posted: 03 Aug 2020 01:17 PM PDT No matter which industry you belong to, the need today is 'automation'. Companies are heavily investing in developer tools to automate many repetitive tasks and when it comes to DevOps, that is the theme, ZERO-TOUCH automation. In the software development world, the build artifacts play a vital role and can be automated down the line so that the company can have an added advantage to release the software fast. In this regard, today, we are going to see why and how a binary repository manager can help companies to release fast and win customer expectations. The explosion of binaries happened over time. Every company is a software company, with the ever-growing technology stack and advancements, binaries will also grow for various business needs. Hence, binaries are very important in the software development life cycle. It all started with the evolutionary software methodologies like Agile, CI/CD practice, DevOps approach along with Microservices and tools like Docker and Kubernetes where the build artifacts played a vital role for developers. Most of the time, the focus was, how the software is produced, and how it is handled way further in the development cycle.

How to Create a Jenkins Declarative Pipeline Posted: 03 Aug 2020 01:12 PM PDT Jenkins introduced a Declarative pipeline which allows one to break the whole process into different stages/jobs which trigger each other in a sequence. The key feature is Pipeline-as-a-code which allows us to define the entire pipeline flow as code in a text file. JenkinsFile A text file that contains the entire workflow as code that can be checked into SCM/VCS just like the rest of the code and triggers the pipeline if present otherwise the pipeline will be created. Go to the application and create a new file (right-click on the project -> New -> File) at the same level as the POM file, give the name as JenkinsfilePaste the code given below in that. pipeline { agent any stages { stage('Build') { steps  { bat 'mvn clean package' } } stage('Deploy') { steps { bat 'mvn deploy -DmuleDeploy' } } } } The script starts with a pipeline tag that contains the entire process of the workflow. The agent specifies where the entire Pipeline, or a specific stage, will execute in the Jenkins environment depending on where the agent section is placed, it must be defined at the top level. Agents can be defined at stage level also. The next block, stages contain all the work that needs to be carried out. It specifies one or more stage which is executed sequentially.  Each stage performs a specific task. The first stage "Build" simply builds the project and creates a JAR file that is deployed to the Cloudhub by the second stage. Use sh for shell scripts and bat for Windows Batch scripts Check-in the file along with the rest of the code. Creating the Pipeline Go to Jenkins -> New item. Select Pipeline and click OK. On the next screen provide Description (optional). Select GitHub hook trigger for GITScm polling under Build Triggers and configure webhook in Github as shown in here. In the Pipeline section, select Pipeline script from SCM, select the SCM (selected Git here) and provide the repository URL and credentials. Specify the script path, by default the path is for the root level, change if Jenkinsfile is not at the root level. Click Save. Trigger the build. Pipelines can be configured for human input or approval before continuing further. Java   x   1  stage('Deploy') { steps { input('Continue to Deploy?') bat 'mvn deploy -DmuleDeploy' } }

Promoting APIs and API Implementations to Higher Environments Posted: 03 Aug 2020 12:45 PM PDT Working with several customers and one major hurdle several occasions i.e. promoting API to upper environment. Let's discuss an approach with steps to accomplish better practice for it...

MicroProfile Config With etcd Posted: 03 Aug 2020 11:52 AM PDT In this short video, Rudy de Busscher demonstrates how to use MicroProfile Config with etcd.  Eclipse MicroProfile has been created as a open source specification for Enterprise Java microservices. It's aim is to work on microservices patterns for Enterprise Java and to integrate applications with the infrastructures they run on, with patterns like health checks, metrics, etc. The MicroProfile project was launched in June 2016 as a collaborative effort between Java application server vendors and the enterprise Java community to enable fast innovation.

RESTful API Design Driven Approach Posted: 03 Aug 2020 11:51 AM PDT In this tutorial I will show you the fundamentals of designing a RESTful API specification by applying REST principles and best practices, then you'll be ready to try my online tutorial: How to design a REST API with API Designer? If you already know what is meant by API in the context of RESTful web services, you can skip to the next section. If not, read on.

Optimizing a Simple Ray-Tracer Written in Go Part 2 Posted: 03 Aug 2020 11:49 AM PDT This is the second part of my mini-series on how I used the go profiling and built-in benchmarking tools to optimize a naive ray-tracer written in Go. For part 1, click here. Sorting efficiently Slices vs Arrays Pointers or values? AVX2 using c2goasm A final word on threading Conclusion (Note: Most of this blog post was written based on using Go 1.13) This part takes off directly after part 1.

CircleCI vs Jenkins: Choosing The Right CI/CD Tool Posted: 03 Aug 2020 11:36 AM PDT If you work in the software industry, you must have realized the never-ending demand for evolution at a particular stage. This is why modern SDLC has more emphasis on the Continuous Integration and Delivery as it helps the DevOps team deliver the software faster with good quality. Gone are the days when Jenkins was the only CI-CD tool that one could think of! Many new CI-CD tools have emerged with out-of-the-box features that make you wonder about which CI-CD should you choose.  One such tool in the CI-CD tug of war is CircleCI which modernizes CI/CD practices by overcoming certain limitations of Jenkins. On the other hand, being one of the oldest players in the CI-CD market, Jenkins has a large user base with an easy learning curve as you get a lot of content & community forums around it. So which one should you use? Should you go for CircleCI or Jenkins? Well, that's exactly what I would help you decide by the end of this article.

Swift Package Manager, Part 1: Introduction to Swift Package Manager Posted: 03 Aug 2020 11:35 AM PDT What is Swift Package Manager? The Swift Package Manager is a tool for managing the distribution of Swift code. It's integrated with the Swift build system to automate the process of downloading, compiling, and linking dependencies.

Working of Package Manager in Linux Posted: 03 Aug 2020 11:04 AM PDT Package Manager is used to automating the process of installing, upgrading, configuring, and removing programs. There are many Package Manager today for Unix/Linux-based systems. Package Managers are available in different languages like python, ruby, etc.  What Is a Package? A package is simply an archive that combines all the libraries and binaries, configuration and all the dependencies required to install the programs (i.e application, software or languages)

Get More Transparency on Your Microservices API With OpenAPI Posted: 03 Aug 2020 10:59 AM PDT Every Friday, Platform.sh has a nice tech discussion about several discussions, such as Jakarta EE, Payara, Quarkus, and so on (To check the calendar you can click here). On Episode number 15 there was a great discussion about Open API and Postman. That's worth watching if you don't yet. First, let's start with Open API definition, from the website it says:

How to Use Protobuf With Apache Kafka and Schema Registry Posted: 03 Aug 2020 10:48 AM PDT Since Confluent Platform version 5.5, Avro is no longer the only schema in town. Protobuf and JSON schemas are now supported as first-class citizens in Confluent universe. But before I go on explaining how to use Protobuf with Kafka, let's answer one often-asked question: Why Do We Need Schemas? When applications communicate through a pub-sub system, they exchange messages and those messages need to be understood and agreed upon by all the participants in the communication. Additionally, you would like to detect and prevent changes to the message format that would make messages unreadable for some of the participants.

Cybersecurity Technologies You Should Be Aware of in 2020 Posted: 03 Aug 2020 10:31 AM PDT Technology is advancing day by day, but hackers are always ahead or known to the technology to easily crack it. There are many types of attacks, and it may be malware, a software attack, or threats to your system. Hackers or cybercriminals are getting smarter every hour or minute. People get fooled by their excellent approaching techniques.

Kustomize Your Kubernetes Deployments Posted: 03 Aug 2020 10:04 AM PDT When  you start working with Kubernetes, you may get to a point where you're shocked at how complex your YAML files have become. For a complex application consisting of different containers your YAML files will become very very long and it will become harder to change a single piece of configuration like the name of your application without breaking things. This is also known as the YAML hell.  A lot has already been written about how to work around this. Bash programmers write their own scripts and you may have already heard of the tool Helm Charts. I myself am not a very good Bash programmer and also I am not a friend of Helm Charts, because they only make the topic worse. The good news is that there is already an official solution called Kustomize. This declarative approach was originally a separate project which has become a part of Kubernetes since version 1.14. So there is no longer any reason to deal with endlessly long YAML files or Helm Charts if you just want to customize some details of your Kubernetes deployments. And you don not need to install any additional tools for this!

Design, Develop, Deploy and Manage a RESTful Application With MuleSoft Posted: 03 Aug 2020 10:01 AM PDT This article shows you how to design, develop, deploy, and manage a simple RESTful Application using MuleSoft. Let us take a simple real-time scenario of how ATM works internally.

Jenkins Pipeline Groovy script - Part 2 Add a User to a Gitlab Group Posted: 03 Aug 2020 09:54 AM PDT My earlier post on Jenkins Pipeline Groovy script - Part 1 , discusses about how to create Gitlab group using Jenkins Pipeline Groovy script. In this post, I am discussing about how to add list of Users to newly created Gitlab group or existing group with specific permission granted to them. In companies while handling big projects and maintaining enormous code repositories, it is very much important to know what permissions supposed to be given to each member in the team.  Because giving wrong permission to team member, opens big path for problems if the team member really unaware about how efficiently the permission can be used for good purpose. Hence giving right permissions to the team member is very serious business for quick and reliable delivery. And yes, this also avoids team member intervening unnecessarily to the projects where they do not actually belong.

Jbang - The Power of Shell Scripting for Java Posted: 03 Aug 2020 09:47 AM PDT Whenever a new Java library is out, developers would be curious to try it out. However, it is sometimes cumbersome to set up the project in the IDE or as a Maven project along with the dependencies. Of course, classpaths can be set in the command line, but it is still cumbersome for the lazy developers ;-) jbang is here to the rescue! Setting up the project to try out a library or running a Java file is going to be a thing of the past with jbang! Of course, Java has the JShell, but jbang seems to be better in many ways. jbang is a neat little tool written by Max Rydahl Andersen (maxandersen) that enables running java as scripts anywhere with java or jshell helping to try out any Java API without the need to install, setup nor configure the project for Maven, Gradle or any other build system A quick feature list for jbang is:

Local Kubernetes Testing With KIND Posted: 03 Aug 2020 09:41 AM PDT Intro If you've spent days (or even weeks?) trying to spin up a Kubernetes cluster for learning purposes or to test your application, then your worries are over. Spawned from a Kubernetes Special Interest Group, KIND is a tool that provisions a Kubernetes cluster running IN Docker. From the docs:

Personal Mini Toolchains Posted: 03 Aug 2020 09:40 AM PDT It's all about repetition. If you found yourself doing the same thing again and again for many times, then chances are, you want to simplify that and eventually automate it. Even the small task makes sense to automate if the amount of repetition is high enough. Let me give you an example. Let's imagine you write a script to synchronize files in between the projects. It took you 8 hours to create that script and each run saves 10 minutes of your time. This means you need to run that script 48 times to "pay off" your initial investment. Anything more than that is your "profit".

How to Exercise the 5 Scrum Values on Your Scrum Team Posted: 03 Aug 2020 09:37 AM PDT The Scrum Values are the human components of Scrum. When exercised by members of the Scrum Team, better products are released because team members are more creative, productive, and empathetic. Without the Scrum Values, the Scrum Framework could be used to deliver complex products at all costs—without regard to the wellbeing of the Scrum Team. In this post, we want to explore the meaning of each value in more detail and ways for you to exercise these five values. These five values have helped our product team create structure in our weekly releases, as a distributed team, and will help yours achieve the full potential of Scrum. Let's dive in!

Securing gRPC Microservices With Istio Service Mesh Posted: 03 Aug 2020 09:29 AM PDT Recently we started a meetup group targeting IAM developers in 7 locations globally: Mountain View, Toronto, London, Sydney, Singapore, Bangalore, and Colombo. In the following session I did at the 7th IAM4Developers meetup, I talked about securing gRPC microservices with Istio in a Kubernetes deployment. The recording of the #IAM4Developers meetup:

Setting Up an MVC Core 3.1 Application With an Empty Template Posted: 03 Aug 2020 09:24 AM PDT Introduction Today I will explain you, how you can setup MVC Core 3.1 Application in visual studio 2019. We will understand it from scratch. What is ASP.Net Core? ASP.Net core is a free and open-source management and computer framework for Windows, macOS, and LINUX operating systems. It is a cross-platform .NET framework. Using ASP.NET core we can develop a modern internet-connected application for cross-platform use.

AWS EKS: Fine-Grained IAM Roles for Service Accounts (IRSA) Posted: 03 Aug 2020 09:20 AM PDT AWS is renowned for its robustness and flexibility, and one of the reasons for that is the fact that it has an extensive set of APIs and automation tools. AWS APIs are not just handy for managing cloud environments, but also for integrating the services within AWS and cloud-native applications running on top of it. In the old days, you had to set up an IAM role for your worker node with extra permissions. That is no longer the case now that IAM Roles for Service Accounts, or IRSA, is available. Rather than compromising security by giving worker nodes more permissions, you can now ask services to communicate with AWS APIs directly. This is Amazon's way of replacing tools like kiam or kube2iam specifically for Kubernetes.

gRPC Basics Posted: 03 Aug 2020 09:19 AM PDT As part of our protocol evaluation in the last blog, we evaluated Apache AVRO. In continuation let's try to evaluate protocol buffer (protobuf). The easiest and simplest way to evaluate protobuf is through gRPC. Let's try to understand what is protobuf and gRPC. What is protobuf? Let's take it from official website. "Protocol buffers are Google's language-neutral, platform-neutral, extensible mechanism for serializing structured data – think JSON, but smaller, faster, and simpler. You define how you want your data to be structured once, then you can use special generated source code to easily write and read your structured data to and from a variety of data streams and using a variety of languages."z There are two versions :

You are subscribed to email updates from DZone.com Feed. To stop receiving these emails, you may unsubscribe now.	Email delivery powered by Google
Google, 1600 Amphitheatre Parkway, Mountain View, CA 94043, United States