logo
Apache Lounge
Webmasters

 

About Forum Index Downloads Search Register Log in RSS X


Keep Server Online

If you find the Apache Lounge, the downloads and overall help useful, please express your satisfaction with a donation.

or

Bitcoin

A donation makes a contribution towards the costs, the time and effort that's going in this site and building.

Thank You! Steffen

Your donations will help to keep this site alive and well, and continuing building binaries. Apache Lounge is not sponsored.
Post new topic   Forum Index -> Apache View previous topic :: View next topic
Reply to topic   Topic: Custom module to modify headers before ProxyPass
Author
ApacheUser1212123



Joined: 22 Feb 2021
Posts: 7

PostPosted: Mon 22 Feb '21 23:25    Post subject: Custom module to modify headers before ProxyPass Reply with quote

Hey,

I have created my own module to modify request headers based on query from database. my module looks like this:

Code:

static int my_apache2_module_handler(request_rec *r) {
    PGconn* conn = PQconnectdb(pg_connection_string);
    if (PQstatus(conn) == CONNECTION_BAD) {
        ap_log_rerror(APLOG_MARK, APLOG_ERR, 0, r, "Connection to database failed : % s\n", PQerrorMessage(conn));
        return HTTP_INTERNAL_SERVER_ERROR;
    }
// All query logic

    apr_table_setn(r->headers_out, my_header, PQgetvalue(res, 0, 0));
    PQclear(res);
    return OK;
}

static void my_apache2_module_register_hooks(apr_pool_t *p)
{
    ap_hook_handler(my_apache2_module_handler, NULL, NULL, APR_HOOK_MIDDLE);
}

...

/* Dispatch list for API hooks */
module AP_MODULE_DECLARE_DATA my_apache2_module_module = {
    STANDARD20_MODULE_STUFF,
    NULL,                  /* create per-dir    config structures */
    NULL,                  /* merge  per-dir    config structures */
    NULL,                  /* create per-server config structures */
    NULL,                  /* merge  per-server config structures */
    directives,                  /* table of config file commands       */
    my_apache2_module_register_hooks  /* register hooks                      */
};


I'm trying to make this headers modification before proxy pass (I.E. get some header from user request and add header with value from db before passing it).

I have created vhost looks like that:
Code:

LoadFile /usr/lib64/libpq.so.5

<VirtualHost *:443>
...
   DirectoryIndex index.html index.php
   ProxyPreserveHost On
   
   <LocationMatch "/*">
   LoadModule my_apache2_module_module /usr/lib64/httpd/modules/mod_my_apache2_module.so
   ...
    ProxyPasssReverse http://127.0.0.1:4444
   </LocationMatch>
</VirtualHost>

Listen 444 http


The module itself seems to work. I can see the headers I have added, but the request doesn't forwarded.

By this virtual host logs, it looks like it trying to access index file in his /var/www folder, instead of forward the request.

If I remove my custom module the resquest is forwarded correctly.

How can I make the headers modification works with the proxypass?
Back to top
tangent
Moderator


Joined: 16 Aug 2020
Posts: 305
Location: UK

PostPosted: Tue 23 Feb '21 14:02    Post subject: Reply with quote

Not sure if I'm missing something obvious, but if you're looking to add to the headers being passed through mod_proxy, then don't you need to update r->headers_in rather than r->headers_out?

Request rather than response.
Back to top
ApacheUser1212123



Joined: 22 Feb 2021
Posts: 7

PostPosted: Tue 23 Feb '21 14:57    Post subject: Reply with quote

Thanks for your replay.

I have used RequestHeader set before so I thought it should be the same.

I have tried to change the request headers instead, but I still have the same problem.

If I register my module with

Code:
ap_hook_handler(my_apache2_module_handler, NULL, NULL, APR_HOOK_REALLY_LAST);


The request reach the destination without the wanted header.

and If I change it to
Code:
ap_hook_handler(my_apache2_module_handler, NULL, NULL, APR_HOOK_REALLY_FIRST);


The request is handled by my module and doesn't forwarded to the destination at all.

My current configuration is like that:

Code:

LoadFile /usr/lib64/libpq.so.5
LoadModule my_apache2_module_module /usr/lib64/httpd/modules/mod_my_apache2_module.so
<LocationMatch "/*">
pgConnectionString "postgresql:///..."
#RequestHeader set "myheader" "somevalue"
ProxyPassMatch http://127.0.0.1:4440
ProxyPassReverse http://127.0.0.1:4440
</LocationMatch>


the pgConnectionString is parameter for my module. I have tried to use the RequestHeader set and the header was added correctly.

Is there a way to make the request handle by my module and then keep it handled by the proxy module?
Back to top
tangent
Moderator


Joined: 16 Aug 2020
Posts: 305
Location: UK

PostPosted: Tue 23 Feb '21 16:29    Post subject: Reply with quote

Believe you'll need to review and debug your module code somewhat further, in conjunction with https://httpd.apache.org/docs/2.4/developer/modguide.html, and also by looking at existing module code for guidance.

For me, I'd comment out the database query aspect of your module for now, and simply try to add a static string to the request headers.

Code:
apr_table_setn(r->headers_in, "test_header", "testing");

Once you've confirmed that's being passed through mod_proxy, you can then go back to adding your database query result.

You might want to consider apr_table_set() rather than apr_table_setn(), since presumably PQclear(res) clears down the results before the headers are processed by mod_proxy.


Last edited by tangent on Wed 24 Feb '21 18:01; edited 2 times in total
Back to top
ApacheUser1212123



Joined: 22 Feb 2021
Posts: 7

PostPosted: Tue 23 Feb '21 19:05    Post subject: Reply with quote

Thanks

I couldn't make my module work with the mod_proxy, so I have tried to copy the mod_headers module (from https://github.com/apache/httpd/blob/trunk/modules/metadata/mod_headers.c) and recompile it (I have changed the TAKE variables names and the module name), so I can try to see how it works. But once I have tried to load it, I got the following error:

Quote:

... is garbled - expected signature 41503234 but saw 00000000 - perhaps this is not an Apache module DSO, or was compiled for a different Apache version?


Do you know where can I find the current version of the mod_headers module?
Back to top
tangent
Moderator


Joined: 16 Aug 2020
Posts: 305
Location: UK

PostPosted: Tue 23 Feb '21 19:31    Post subject: Reply with quote

I'm a little confused.

I'd have thought you were compiling your custom module around the appropriate release of source code, since you'll need any number of header files, libraries, etc.

Based on your Apache version, you can download the appropriate source package from here https://archive.apache.org/dist/httpd
Back to top
ApacheUser1212123



Joined: 22 Feb 2021
Posts: 7

PostPosted: Tue 23 Feb '21 19:46    Post subject: Reply with quote

Yes, I'm trying to create my own module, but I couldn't manage to get the headers modification works with the mod_proxy, so I copied the mod_headers module and try to recompile it.

I have tried to copy the module and copy its logic to my own module.

I saw the mod_headers module use filter rather than hooks register. Do you think filter is needed for what I'm trying to do?
Back to top
tangent
Moderator


Joined: 16 Aug 2020
Posts: 305
Location: UK

PostPosted: Tue 23 Feb '21 22:58    Post subject: Reply with quote

I don't believe you need to go down the complexity of a filter for what you're trying to achieve, but will bow to wisdom from other forum contributors to this site.

Start simple, test and iterate to build up the functionality you require.
Back to top
tangent
Moderator


Joined: 16 Aug 2020
Posts: 305
Location: UK

PostPosted: Mon 01 Mar '21 22:43    Post subject: Reply with quote

This topic has been niggling me, so I've spent a while looking into it.

The following stripped down module source code does insert a request header (fixed string for testing), which then gets passed through mod_proxy.

The only trick used beyond your code is to ensure the successive module in the ap_hook_fixups is mod_proxy (based on this tip: https://stackoverflow.com/questions/11097096/ensure-execution-order-of-two-apache-filters).

Code:
#include "httpd.h"
#include "http_log.h"
#include "http_request.h"

static int add_headers_in_module_fixups_handler(request_rec* r) {
    apr_table_set(r->headers_in, "Apache-Lounge", "Testing");
    return OK;
}

static void add_headers_in_register_hooks(apr_pool_t* p) {
    static const char * const aszSucc[] = {"mod_proxy.c", NULL};
    ap_hook_fixups(add_headers_in_module_fixups_handler, NULL, aszSucc, APR_HOOK_FIRST);
}

/* Dispatch list for API hooks */
module AP_MODULE_DECLARE_DATA add_headers_in_module = {
    STANDARD20_MODULE_STUFF,
    NULL,                          /* create per-dir    config structures */
    NULL,                          /* merge  per-dir    config structures */
    NULL,                          /* create per-server config structures */
    NULL,                          /* merge  per-server config structures */
    NULL,                          /* table of config file commands       */
    add_headers_in_register_hooks  /* register hooks                      */
};

Here's sample proxied request / response headers captured with Wireshark, showing the Apache-Lounge request header is present.
    GET /images/default.gif HTTP/1.1
    Host: dsldevice.lan
    User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0
    Accept: image/webp,*/*
    Accept-Language: en-GB,en;q=0.5
    Accept-Encoding: identity
    Referer: https://test.somewhere.net/
    DNT: 1
    Sec-GPC: 1
    If-Modified-Since: Thu, 08 Nov 2018 16:22:35 GMT
    Cache-Control: max-age=0
    Apache-Lounge: Testing
    X-Forwarded-For: 192.168.56.1
    X-Forwarded-Host: test.somewhere.net
    X-Forwarded-Server: test.somewhere.net
    Connection: Keep-Alive

    HTTP/1.1 304 Not Modified
    Content-Type: image/gif
    Cache-Control: public
    Pragma: cache
    Expires: Mon, 01 Mar 2021 20:32:23 GMT
    Date: Mon, 01 Mar 2021 20:02:23 GMT
    Last-Modified: Thu, 08 Nov 2018 16:22:35 GMT
    Accept-Ranges: bytes
    Connection: Keep-Alive
Hope this helps.
Back to top
James Blond
Moderator


Joined: 19 Jan 2006
Posts: 7288
Location: Germany, Next to Hamburg

PostPosted: Mon 08 Mar '21 11:08    Post subject: Reply with quote

just as an addition you may also take a look at http://httpd.apache.org/docs/current/developer/hooks.html
Back to top


Reply to topic   Topic: Custom module to modify headers before ProxyPass View previous topic :: View next topic
Post new topic   Forum Index -> Apache