How do I stream data from Kafka to Elasticsearch?

Use Kafka Connect! Not sure what Kafka Connect is or why you should use it instead of something like Logstash? Check out the talk I did at Kafka Summit in London earlier this year. Kafka Connect’s Elasticsearch sink connector has been improved in 5.3.1 to fully support Elasticsearch 7. To stream data from a Kafka topic to Elasticsearch create a connector using the Kafka Connect REST API. The parameters vary slightly between releases of Elasticsearch.

Encryption and Authentication with SSL

Table of Contents SSL Overview Creating SSL Keys and Certificates Brokers Clients ZooKeeper Kafka Connect Confluent Replicator Confluent Control Center Confluent Metrics Reporter Confluent Monitoring Interceptors Schema Registry REST Proxy SSL Logging SSL Overview With SSL authentication, the server authenticates the client (also called “2-way authentication”). Since SSL authentication requires SSL encryption, this page shows … Lire la suite Encryption and Authentication with SSL

Installing Prometheus Monitoring Server with a Grafana Dashboard

This tutorial explains how to use a Prometheus Monitoring server with Grafana Dashboard. Requirements You have an account and are logged into console.scaleway.com You have configured your SSH Key Prometheus is a flexible monitoring solution that is in development since 2012. The software stores all its data in a time series database and offers a … Lire la suite Installing Prometheus Monitoring Server with a Grafana Dashboard

How To Use Curl with HTTPS Protocol and URLS?

Curl is a command line tool and library which implements protocols like HTTP, HTTPS, FTP etc. Curl also supports HTTPS protocol which is secure version of the HTTP. Using curl may create some problems. We will examine how to solve these curl HTTPS related problems. Install Curl We will start with the installation of the curl tool … Lire la suite How To Use Curl with HTTPS Protocol and URLS?

IIS : Create CSR and Install SSL Certificate

Creating a CSR and installing your SSL certificate on your Windows server 2016 Use the instructions on this page to use IIS 10 to create your certificate signing request (CSR) and then to install your SSL certificate on your Windows server 2016. To create your certificate signing request (CSR), see IIS 10: How to Create … Lire la suite IIS : Create CSR and Install SSL Certificate

kubectl Cheat Sheet

This page is an overview of the kubectl command. Kubectl Autocomplete Kubectl Context and Configuration Apply Creating Objects Viewing, Finding Resources Updating Resources Patching Resources Editing Resources Scaling Resources Deleting Resources Interacting with running Pods Interacting with Nodes and Cluster What's next kubectl - Cheat Sheet Kubectl Autocomplete BASH source <(kubectl completion bash) # setup autocomplete in … Lire la suite kubectl Cheat Sheet

Use a cURL with a username and password?

I want to access a URL that requires a username/password.I want to try it curl Access it.Now I'm doing something similar: curl http://api.somesite.com/test/blah?something=123 I got an error.I think I need to specify a username and password as well as the above commands. How can I do this? #1st floor Same but different grammar curl http://username:password@api.somesite.com/test/blah?something=123 #2nd floor … Lire la suite Use a cURL with a username and password?

Installing a Kubernetes cluster on the enterprise-friendly CentOS 7 server platform.

Kubernetes is an open-source system used for automating the deployment, scaling, and management of containerized applications. Kubernetes is enterprise-ready and can be installed on various platforms. I've already touched on how to get Kubernetes up and running on Ubuntu Server (see "How to quickly install Kubernetes on Ubuntu"). This time around, I'm going to walk … Lire la suite Installing a Kubernetes cluster on the enterprise-friendly CentOS 7 server platform.

Working with plugins

Logstash has a rich collection of input, filter, codec and output plugins. Plugins are available as self-contained packages called gems and hosted on RubyGems.org. The plugin manager accessed via bin/logstash-plugin script is used to manage the lifecycle of plugins in your Logstash deployment. You can install, remove and upgrade plugins using the Command Line Interface (CLI) … Lire la suite Working with plugins

Install GitLab Runner manually on GNU/Linux

Last updated: 2017-10-09 • If you can’t use the deb/rpm repository to install GitLab Runner, or your GNU/Linux OS is not among the supported ones, you can install it manually using one of the methods below, as a last resort. If you want to use the Docker executor, you must install Docker before using the Runner. Make sure that you … Lire la suite Install GitLab Runner manually on GNU/Linux

GitLab Runner commands

GitLab Runner contains a set of commands with which you register, manage and run your builds. You can check a recent list of commands by executing: gitlab-runner --help Append --help after a command to see its specific help page: gitlab-runner <command> --help Using environment variables Most of the commands support environment variables as a method to pass … Lire la suite GitLab Runner commands