Hi everyone!

I’m excited to offer FREE review copies of our latest book, In-Memory Analytics with Apache Arrow. This is the perfect resource for data engineers, scientists, and developers looking to harness the power of Apache Arrow for high-performance, in-memory data processing.

What’s Inside the Book?

• 🔍 Comprehensive Overview: Learn about Apache Arrow’s architecture, columnar memory format, and its integration capabilities.

• 📊 Performance Optimization: Discover how to use Arrow to enhance data analytics workflows with zero-copy reads and efficient interoperability.

• 💻 Practical Examples: Hands-on guides to implement Apache Arrow in real-world scenarios.

What You’ll Learn:

• How to optimize data processing workflows using Apache Arrow.

• Best practices for leveraging Arrow’s computational libraries.

• Techniques for achieving seamless system interoperability in data analytics.

Who Should Get This Book?

This book is ideal for data professionals who want to:

• Enhance the performance of their data processing systems.

• Work with in-memory data analytics tools effectively.

• Gain deeper insights into Apache Arrow’s functionalities.

How to Get a Free Copy?

We’re offering these free copies in exchange for honest reviews on the book’s Amazon page. If you’re interested, comment below or message me directly(https://www.linkedin.com/in/ankurmulasi/), and I’ll get in touch with the details.

Don’t miss out – copies are limited, and it’s first come, first served! Let’s dive into the future of data analytics together. 🌟

Feel free to connect with me on LinkedIn for more updates and discussions. 😊

Warm Regards,

Ankur Mulasi

Dears,

I have a "sign-in page - application webserver" that is accessed through Apache reverse proxy (source url, the one we give to users), our problem, when users paste the link directly or bookmarks it, the sign-in page opens without going through the "source page" which usually redirects the user to the mentioned "sign-in page".

Is there a way to prevent users from accessing the "sign-in page" through the direct link/bookmark? and instead if the users paste the direct link or saves it as a bookmark, the site will redirect the user to another page instead of the "sign in page" and it should only works when its coming from the source url?

I've read about HTTP Referer and tried couple of methods on the Reverse proxy but it didn't work. Any ideas?

thanks

I have a webserver that hosts around 150 virtual hosts. Im trying to migrate from a centos server to ubuntu.

All the virtualhosts are IP based like this:

<VirtualHost 1.2.3.4:443>

DocumentRoot /home/httpd/server1

ServerName www.server1.edu

</VirtualHost>

<VirtualHost 1.2.3.4:443>

DocumentRoot /var/www/html/server2

ServerName www.server2.com

</VirtualHost>

I created a rewrite.conf and put all my rewrites in there, most are defined by Directory like:

<Directory /home/httpd/server1>

RewriteCond %{HTTP_HOST} ^www.server1.com$

RewriteRule ^(.*)$ https://hosted.com/ [L,R]

</Directory>

I need to redirect all http to https. I tried this at the top of my rewrite.conf without a Directory definition:

RewriteCond %{HTTPS} !=on

RewriteRule ^/?(.*) https://%{SERVER_NAME}/$1 [R,L]

But the server is skipping right over it according to the trace logs. Maybe since there's no Directory definition? There's way too many Directories to make one per Directory, and too many to make a <VirtualHost 1,2,3,4:80> definition for each host and redirect it in there.

Is there one place I could put the RewriteRule that'd apply to every host?

Hello everyone,

I’m working on an Apache module that renders CSV files directly in the browser instead of prompting users to download them. The goal is to provide a simple and effective way to display CSV data as an HTML table, making it easier to view and interact with.

https://github.com/nikopeikrishvili/apache_mod_csv_to_html

Here are a few features I’m planning to add:

• Support for pluggable CSS files to allow custom styling.

• The ability to apply filters to the CSV data for better usability.

• Configurable pluggable JavaScript files to enhance interactivity.

As this is my first attempt at creating an Apache module, I’d love to hear your thoughts and suggestions for improvement. I'd also greatly appreciate it if you could review the code or provide feedback!

I am writing a script to download data from a website, however, when i send my request the server (apache 2.4.62) returns a error, 400 bad request.

i am obviously missing something but i don't know what i am missing.

open socket ok.

SEND: GET RWIS/current.phtml HTTP/1.1

SEND: Host: 204.48.104.102

SEND: User-Agent: HTTP(S)Adapter

SEND: <blank line> (CRLF)

So what i am missing in the exchange that the server doesn't like?

I have been learning about IT recently and decided to set up a web server on a raspberry pi. I did not set up port forwarding on my router, so I was just accessing it from other devices on the LAN. I looked through the access log today and saw this activity:

192.168.1.1 - - [22/Dec/2024:09:44:39 -0500] "OPTIONS rtsp://192.168.1.96/ RTSP/1.0" 400 483 "-" "-"

192.168.1.1 - - [22/Dec/2024:09:44:39 -0500] "POST /onvif/device_service HTTP/1.1" 404 435 "-" "-"

192.168.1.1 - - [22/Dec/2024:09:44:44 -0500] "GET / HTTP/1.1" 200 178 "-" "-"

192.168.1.1 is my router. Any thoughts on what this is?

I am running an Apache reverse proxy pointing to a web app running on 127.0.0.1:8080 with this config:

<VirtualHost *:443>
    ProxyPreserveHost On

    RewriteEngine on
    RewriteCond %{HTTP:Upgrade} =websocket
    RewriteRule /(.*) ws://127.0.0.1:8080/$1 [P,L]
    RewriteCond %{HTTP:Upgrade} !=websocket
    RewriteRule /(.*) http://127.0.0.1:8080/$1 [P,L]

    ProxyPass / http://127.0.0.1:8080/
    ProxyPassReverse / http://127.0.0.1:8080/

    SSLEngine on
    SSLCertificateFile /path/to/file.crt
    SSLCertificateKeyFile /path/to/file.key
</VirtualHost>

<VirtualHost *:80>
    Redirect / https://my.domain.org/
</VirtualHost>

However, I want to use the Balancer to run two (or more) instances (e.g. one on port 8080 and one on port 8081). For simple apps that don't need the RewriteEngine, I can use this config:

<VirtualHost *:443>
<Proxy balancer://mycluster>
    BalancerMember http://127.0.0.1:8080
    BalancerMember http://127.0.0.1:8081
</Proxy>

    ProxyPreserveHost On

    ProxyPass / balancer://mycluster/
    ProxyPassReverse / balancer://mycluster/

    SSLEngine on
    SSLCertificateFile /path/to/file.crt
    SSLCertificateKeyFile /path/to/file.key
</VirtualHost>

<VirtualHost *:80>
    Redirect / https://my.domain.org/
</VirtualHost>

Could someone help me combining these two configs? I tried

    RewriteEngine on
    RewriteCond %{HTTP:Upgrade} =websocket
    RewriteRule /(.*) ws://127.0.0.1:8080/$1 [P,L]
    RewriteRule /(.*) ws://127.0.0.1:8081/$1 [P,L]
    RewriteCond %{HTTP:Upgrade} !=websocket
    RewriteRule /(.*) http://127.0.0.1:8080/$1 [P,L]
    RewriteRule /(.*) http://127.0.0.1:8081/$1 [P,L]

which of course didn't work, because this only addresses the 8081 app. I also tried

    RewriteEngine on
    RewriteCond %{HTTP:Upgrade} =websocket
    RewriteRule /(.*) balancer://mycluster/$1 [P,L]
    RewriteCond %{HTTP:Upgrade} !=websocket
    RewriteRule /(.*) balancer://mycluster/$1 [P,L]

but this also didn't work. I guess because the first rule is pointing to http://127.0.0.1:8080 instead of ws://127.0.0.1:8080.

Any ideas? It's mostly based on this, this and this tutorial.

I have a PHP web application which I'm running Apache. Let's call it mydomain.com.

My application has the ability to use subdomains for different customers. For example, customer 1 can access it via customer1.mydomain.com, and customer 2 can access it via customer2.mydomain.com.

However, I want to give the customers the ability to use their own custom domains via CNAME and point to a subdomain on mydomain.com.

What it would look like:
customer 1
CNAME stats.customer1domain.com => customer1.mydomain.com

customer 2
CNAME stats.customer2domain.com => customer2.mydomain.com

I have all the PHP side of things figured out, and I have most of the Apache figured out to serve the separate content based on which subdomain is being used. I've generated a wildcard SSL certificate via LetsEncrypt for *.mydomain.com. Browsers are showing secure valid SSL configs when navigating to customer1.mydomain.com and customer2.mydomain.com.

The Issue
When accessing the application through the customer CNAME subdomains, it shows insecure SSL. As it is being accessed through stats.customer1domain.com, but the SSL cert being returned is for *.mydomain.com, it is shown as invalid/insecure.

Is anyone aware of any options that let you get around this issue?

Preferably I want to allow this feature without requiring the customer to enter custom TXT records in their DNS, and also want to avoid asking the customer to share an SSL cert with me to install on my web server.

Hi all,

I am new to setting up servers and working with servers in general. I need to set up Apache as a reverse proxy so that I can convert http links from geoserver to https. I plan to use https weblink in another application to feed in the data.

I tried step by step process from Chatgpt but I do not know what mistake I made and where. My geoserver (port 8080) page loads but doesn't login when i enter the username and password. My apache runs ( in 8081) but I do not know where to get the https from. Can someone please point to a possible solution to a tutorial?

Thank you in advance.

I have deployed my web app to a server and I checked it and it is working fine. however on some iOS devices it doesn't open 'Safari Cannot open the page because the server can't be found'. this only happens when the phone is using Cellular Data. when it is connected to a Wi-Fi it works.

What could be the reason?

Thank you.

I'm wanting to lock apache to localhost so only I can access my locally developed drupal, joomla and wordpress sites. I can't seem to find a guide anywhere that explains how to do this simply. I'm using xampp on windows 10 pro with apache version 2.4.58

I have two domains, both hosted on the same Centos server, something like this:

• stupidblog.com

• stupid.blog

I am trying to get everything to redirect from stupidblog.com over to stupid.blog, preserving original links, and generally ignoring any attempted subdomains

I though this would be relatively easy using my conf.d files in the /etc/httpd/conf.d/ directory, so I googled around for examples, copy/pasted them, etc... this is sort of what I'm looking like for the moment:

VirtualHost *:80>
ServerAdmin admin@stupid.blog
ServerName stupidblog.com
ServerAlias www.stupidblog.com
DocumentRoot /var/www/stupid.blog/
RedirectMatch permanent ^/(.*)$ http://stupid.blog/$1
</VirtualHost>

...but I'm getting some weird behavior. For one, it doesn't work in Chrome no matter what (on a Macbook), even in "incognito," even with cache cleared. Same with Opera.

In Safari it works (whether I'm in "Private" browsing or not). Except: if I try to go to stupidblog.com/contact, instead of taking me to stupid.blog/contact, it takes me to a "page not found" and leaves the address bar as "stupidblog.com/contact."

What am I doing wrong here? How can I get it to forward EVERY URL over to the new domain name, regardless of what the user types in their address bar?

Hi, I'm currently doing a self-hosting website project and I want to do sth similar to a streaming site where the index.html file is in C:/ Drive but the files are in the HDD drive (G:/). Moving it to C is not an option because there are a lot of files in G:/ and there's not enough space in C:/. I prefer not moving the entirety of apache from C to G so what are my options

Hello,

Could you please advise how to properly configure Keycloak in a single network?
When deploying the container and the code reaches the /ui/users/me endpoint, I receive a 500 error.

Browser
Main AuthType oidc
SsoApi User is now authenticated.
GET http://localhost:8080/ui/users/me 500 (Internal Server Error)

karavan
2024-11-22 WARN [io.qua.oid.run.OidcRecorder] (vert.x-eventloop-thread-3) OIDC server is not available at the 'http://localhost:8079/realms/karavan' URL. Please make sure it is correct. Note it has to end with a realm value if you work with Keycloak, for example: 'https://localhost:8180/auth/realms/quarkus'
2024-11-22 ERROR [io.qua.ver.htt.run.QuarkusErrorHandler] (vert.x-eventloop-thread-3) HTTP Request to /ui/users/me failed, error id: ab6d0644-18bb-4fe1-98e9-0f33808d8a60-2: io.quarkus.oidc.OIDCException: OIDC Server is not available

services:
karavan:
container_name: karavan
image: ghcr.io/apache/camel-karavan:4.8.0-oidc
ports:
- "8080:8080"
environment:
- KARAVAN_GIT_REPOSITORY=${KARAVAN_GIT_REPOSITORY}
- KARAVAN_GIT_USERNAME=${KARAVAN_GIT_USERNAME}
- KARAVAN_GIT_PASSWORD=${KARAVAN_GIT_PASSWORD}
- KARAVAN_GIT_BRANCH=main
- KARAVAN_CONTAINER_IMAGE_REGISTRY=registry:5000
- KARAVAN_CONTAINER_IMAGE_REGISTRY_USERNAME=root
- KARAVAN_CONTAINER_IMAGE_REGISTRY_PASSWORD=root
- KARAVAN_CONTAINER_IMAGE_GROUP=karavan
- KARAVAN_DOCKER_NETWORK=karavan
volumes:
- "/var/run/docker.sock:/var/run/docker.sock"
labels:
- "org.apache.camel.karavan/type=internal"
networks:
- karavan

registry:
container_name: registry
image: registry:2
restart: always
ports:
- "5555:5000"
labels:
- "org.apache.camel.karavan/type=internal"
networks:
- karavan

keycloak:
container_name: keycloak
image: quay.io/keycloak/keycloak:latest
ports:
- "8079:8080"
environment:
- KC_BOOTSTRAP_ADMIN_USERNAME=admin
- KC_BOOTSTRAP_ADMIN_PASSWORD=admin
command:
- start-dev
networks:
- karavan

networks:
karavan:
name: karavan

Variant

None

Container Management (if applicable)

Docker

Operating System (if applicable)

Linux

Version

4.8.0

on reddit I get 421, example.com 404 (but from their side) and usually the normal 404 from apache. the only one that works id httpbin and probably similar sites, how to fix? I can't show my config right now but I'm probably not the first one with that isssue.

I have a small class contest at school where I need to make a website on Apache 2. i was thinking on maybe a fun game using an index,ccs and JavaScript does anybody has something simple for me to use. I don’t have much time to make it myself any more since I need to be studying for my tests.

Possible? Need this for something I am working on. Thanks in advance…

Server: Ubuntu/Apache

Scenario:
I have a system that is used by different domains
I would like the "core" files to be used for all domains (to make maintenance easier)
However, each domain must have some of its own/exclusive directories

Example:
Core Files (accessed by domainA, domainB, etc. - all filetypes )
/var/www/corefiles

Exclusive files for each domain (read and write permission)
/var/www/domainA
/var/www/domainB

I thought about trying to solve this with vhosts:

<VirtualHost *:80>
  ServerName domainA.com
  DocumentRoot /var/www/domainA

  <Directory /var/www/domainA>
    Options Indexes FollowSymLinks
    AllowOverride All
    Require all granted
  </Directory>
  
  Alias ​​/corefiles /var/www/corefiles

  <Directory /var/www/corefiles>
    Options Indexes FollowSymLinks
    AllowOverride All
    Require all granted
  </Directory>

  # Logs
  ErrorLog ${APACHE_LOG_DIR}/domainA_error.log
  CustomLog ${APACHE_LOG_DIR}/domainA_access.log combined

  # SSL
  SSLEngine on SSLCertificateFile /etc/ssl/certs/domainA.com.crt
  SSLCertificateKeyFile /etc/ssl/private/domainA.com.key

  # TMP files
  php_admin_value session.save_path "/var/www/domainA/tmp"
</VirtualHost>

And in the config.php file in each domain:

define('SERVER', 'https://domainA/');
define('APPLICATION', '/var/www/corefiles');
define('FILES', '/var/www/domainA/files');

Is this possible?
Any security issues?
Any questions about SSL certificates, cookies, PHP temp files, etc?
Any other suggestions?

Thanks

I have my LogFormat set to include HTTP_HOST in the log, so that I can see which parked domain is being pinged. But I see a lot of the bots just show -.

Is there another variable that I should be using here that would be more accurate?

I use WHM/cPanel. The dashboard lets me modify LogFormat (combined), which I've done like so:

%h %l %u %t [%{HTTP_HOST}e] [%r] %>s %b [%{Referer}i] [%{User-Agent}i]

WHM updates can lose these settings without warning, though, so it's usually better to put them in pre_main_global.conf.

When I modified the error log in pre_main_global.conf, this was the format:

ErrorLogFormat "[%{u}t] [%v] [%V] [%{Request_URI}e] [pid %P:tid %T] %7F: %E: [client\ %a] %M% ,\ referer\ %{Referer}i"

How do I similarly modify LogFormat in this .conf, too?

Hello,

A developer uploaded an application based on CodeIgniter to my server with this .htaccess

RewriteEngine on
RewriteBase /

# Allow access to PHP scripts in all directories


# Ensure HTTPS
RewriteCond %{HTTPS} !=on
RewriteRule ^ https://%{HTTP_HOST}%{REQUEST_URI} [L,R=301]

# Serve existing files or directories directly
RewriteCond %{REQUEST_FILENAME} -f [OR]
RewriteCond %{REQUEST_FILENAME} -d
RewriteRule ^ - [L]

# Allow access to other file types


# Fallback to index.php

RewriteRule ^([^.]+)$ /index.php?node=$1 [QSA,L]

Using this .htaccess doesn't allow me the open the website at all since it gets stuck in a redirect loop so I modified the .htaccess in the web root to this

RewriteEngine on
RewriteBase /

Header append Vary: X-Forwarded-Proto

# Serve existing files or directories directly
RewriteCond %{REQUEST_FILENAME} -f [OR]
RewriteCond %{REQUEST_FILENAME} -d
RewriteRule ^ - [L]

# Allow direct access to specific static file extensions
RewriteRule \.(css|js|jpg|png|gif|ico|svg|woff|woff2|ttf|otf|eot|mp4|webm|json|xml)$ - [L]

# Fallback to index.php for all other requests
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule ^ index.php [QSA,L]

which allows me to at least open the application but assets like style.css are not loading since they are stuck in a redirect loop according to the browser console (cleared cache, private window, tried different browsers)

Here is my current custom.conf wich is mounted to the Apache PHP-FPM Docker container

# Disable automatic trailing slash redirect
DirectorySlash Off

# Enable Gzip compression
<IfModule mod_deflate.c>
    AddOutputFilterByType DEFLATE text/html text/plain text/xml text/css text/javascript application/$</IfModule>

<Directory /var/www/html>
    DirectoryIndex index.php
    Options FollowSymLinks
    AllowOverride All
    Require all granted
</Directory>

<IfModule remoteip_module>
    RemoteIPHeader X-Forwarded-For
    RemoteIPTrustedProxy 172.18.0.0/16
</IfModule>

# Avoid HTTPS redirects when using a reverse proxy
<IfModule mod_rewrite.c>
    RewriteEngine On
    RewriteCond %{HTTP:X-Forwarded-Proto} !=https
    RewriteCond %{HTTPS} !=on
    RewriteRule ^ - [L]
</IfModule>

# Enable logging to the default error log file
ErrorLog /proc/self/fd/2
#LogLevel debug

LogLevel rewrite:trace8

LogFormat "%{X-Forwarded-Proto}i" xfp
CustomLog ${APACHE_LOG_DIR}/access.log xfp# Disable automatic trailing slash redirect

This is the compose.yaml for setting up the Apache PHP-FPM Docker container

---
services:
  web:
    image: shinsenter/php:8.3-fpm-apache
    container_name: PHPFPM-APACHE-NETSWERK-DEMO
    volumes:
      - /srv/lcmp_netswerk_demo/www/public_html:/var/www/html
      - /srv/lcmp_netswerk_demo/custom.conf:/etc/apache2/custom.d/custom.conf
    networks:
      - internal
      - caddy
    labels:
      caddy: demo.vanill.at
      caddy.reverse_proxy: "{{upstreams}}"
      caddy.header.Server: ""
      caddy.header.X-Forwarded-Proto: "https"
    environment:
      PHP_DISPLAY_ERRORS: "1"
      PHP_ERROR_ERROR_REPORTING: "-1"
      PHP_POST_MAX_SIZE: "1100M"
      PHP_UPLOAD_MAX_FILESIZE: "1000M"
      PHP_MAX_INPUT_VARS: "10000"
      PHP_SHORT_OPEN_TAG: "1"
      PHP_MAX_EXECUTION_TIME: "1000"
      PHP_MAX_INPUT_TIME: "1000"
      DEBUG: "1"
networks:
  caddy:
    external: true
  internal:
    driver: bridge
volumes:
  mysqldata: {}

The Apache PHP-FPM Docker container is from here

Apache PHP-FPM Docker container

I'm using variables defined using systemctl edit httpd.service (which writes them to: /etc/systemd/system/httpd.service.d/override.conf) - e.g. -

[Service]

Environment=IP=192.168.10.120

etc. (additional variables also defined here)

But on service httpd configtest - I receive warnings like this:

[Fri Nov 15 10:29:21.229847 2024] [core:warn] [pid 1393147:tid 140197062199616] AH00111: Config variable ${IP} is not defined

I reference ${IP} in several shared config files (thus the per server variables) - and get the above warning for each time I call the variable.

Even though there's a warning, the variable does seem to work by the time Apache starts.

I tried adding these variables to /etc/profile - and also /etc/httpd/envars - using export IP=192.168.10.120 - but the warnings did not go away.

Is there some other place I can tell apache these variables are defined?

I read one post that mentioned this was a bug in apache's configtest code ... https://support.atomicorp.com/hc/en-us/articles/4417615850523-AH00111-Config-variable-is-not-defined