• Accelerating single TCP connections in syslog-ng: parallelize()

    One of the highlights of the syslog-ng 4.3.0 release is parallelize(). Normally, syslog-ng processes incoming messages from a TCP connection in a single thread. While this works fine with many connections, it is a bottleneck when using a single or ve…
    • 1 Aug 2023
  • Why contribute to syslog-ng upstream?

    One of the returning questions I received recently: why contribute to the syslog-ng upstream? I guess it is a question many open-source projects receive regularly. There are many generic answers. Here I would like to focus more on syslog-ng, focusing…
    • 18 Jul 2023
  • The syslog-ng MongoDB destination receives bulk operations support

    The MongoDB destination of syslog-ng will receive another performance update. Starting with the upcoming version 4.3, it will support bulk operations. Depending on the configuration settings, this may result in a more than 300% performance increase. …
    • 27 Jun 2023
  • What I learned about syslog-ng performance using sngbench

    A few weeks ago, I posted about sngbench, a shell script to measure syslog-ng performance. The performance of syslog-ng is influenced by many factors, including the hardware and OS it runs on, and syslog-ng itself. This blog summarizes some of my fin…
    • 20 Jun 2023
  • Syslog-ng 4.2: extra UDP performance

    No matter how awkward you feel when you hear about UDP syslog in the age of encrypted TCP connections, UDP syslog is here to stay in some special cases. The scalability issues of UDP log collection were first addressed in syslog-ng Open Source Editio…
    • 13 Jun 2023
  • Introducing sngbench: a shell script to performance test your syslog-ng

    One of the returning questions I receive is how many log messages can a given hardware handle. My typical answer is that it depends on the configuration. I have now an answer, or rather a tool to answer your question sngbench.sh. It is a shell script…
    • 6 Jun 2023
  • Syslog-ng Python packaging

    In version 4 of syslog-ng, the role of Python became even more important. Previously, all parts of syslog-ng could be extended using Python code, but no actual Python code was provided with syslog-ng. Version 4.0 added a Kubernetes module implemented…
    • 16 May 2023
  • The syslog-ng insider 2023-05: learning; UDP; upgrading;

    Dear syslog-ng users, This is the 110th issue of syslog-ng Insider, a monthly newsletter that brings you syslog-ng-related news. NEWS Learning syslog-ng, the easier way Last year, one of the returning questions I received was how to learn syslog-…
    • 11 May 2023
  • Getting syslog-ng 4

    Version 4 of syslog-ng was released last December. Quite a few people use it already in production. How can you install it for a test drive? It might be already available in your Linux distribution. There are also several unofficial repositories with…
    • 2 May 2023
  • Upgrade problems from syslog-ng 3 to 4

    Version 4 of syslog-ng works perfectly well in version 3 compatibility mode. However, if you want to use the syslog-ng 4 features, you need to be aware of some significant changes. If you have a simple configuration, like those in Linux distributions…
    • 25 Apr 2023
  • The syslog-ng Insider 2023-04: FreeBSD; Splunk; Deduplication;

    Dear syslog-ng users, This is the 109th issue of syslog-ng Insider, a monthly newsletter that brings you syslog-ng-related news. NEWS Installing a syslog-ng 4 development snapshot on FreeBSD Unless there is a serious problem, FreeBSD ports usuall…
    • 20 Apr 2023
  • Getting data to Splunk

    Getting data to Splunk can be challenging. Syslog is still the most important data source, and it can provide you with hard-to-solve problems (for example, like high volume, non-compliant messages, unreliable network protocol (UDP), and more). The sy…
    • 12 Apr 2023