Consuming all (txt, png, html, odt, doc, docx ) but html

[dmenne]

I had posted this on the gotenberg forum as gotenberg/gotenberg#875; on suggestion of @GUILIEN, I have transferred it to this forum.

Running paperless with Docker image on Synology

• REST using PUT with Insomnia (Postman alternative) to API:9998 with txt, png, html, odt, doc, docx gives correct responses.
• All extensions except html work

[paperless.management.consumer] Not consuming file /usr/src/paperless/consume/Atemtes1t.html: Unknown file extension.
[paperless.management.consumer] Not consuming file /usr/src/paperless/consume/Atemtes1t.htm: Unknown file extension.

// Renamed html to txt
[paperless.consumer] Consuming Atemtes1t.txt

// Correctly identified as html in disguise
[paperless.consumer] Detected mime type: text/html
[paperless.consumer] Unsupported mime type text/html

I suspect some Chromium problem, but how to debug?

...
            PAPERLESS_TIKA_ENABLED: 1
...
    gotenberg:
        container_name: paperless-gotenberg
        image: gotenberg/gotenberg:8
        restart: unless-stopped
        command:
            - "gotenberg"
            - "--chromium-disable-javascript=true"
            - "--chromium-allow-list=file:///tmp/.*"
            - "--api-timeout=300s"
    tika:
        container_name: paperless-tika
        image: apache/tika:2.9.2.0-full
        ports:
            - 9998:9998
        restart: unless-stopped

[Masgalor]

This is not a bug, it is wanted behavior.

Paperless only consumes documents that have a mime-type listed in one of its consumer declarations.

paperless-ngx/src/paperless_mail/signals.py

Lines 7 to 14 in ac666df

	def mail_consumer_declaration(sender, **kwargs):
	return {
	"parser": get_parser,
	"weight": 20,
	"mime_types": {
	"message/rfc822": ".eml",
	},
	}

paperless-ngx/src/paperless_text/signals.py

Lines 7 to 16 in ac666df

	def text_consumer_declaration(sender, **kwargs):
	return {
	"parser": get_parser,
	"weight": 10,
	"mime_types": {
	"text/plain": ".txt",
	"text/csv": ".csv",
	"application/csv": ".csv",
	},
	}

paperless-ngx/src/paperless_tesseract/signals.py

Lines 7 to 20 in ac666df

	def tesseract_consumer_declaration(sender, **kwargs):
	return {
	"parser": get_parser,
	"weight": 0,
	"mime_types": {
	"application/pdf": ".pdf",
	"image/jpeg": ".jpg",
	"image/png": ".png",
	"image/tiff": ".tif",
	"image/gif": ".gif",
	"image/bmp": ".bmp",
	"image/webp": ".webp",
	},
	}

paperless-ngx/src/paperless_tika/signals.py

Lines 7 to 24 in ac666df

	def tika_consumer_declaration(sender, **kwargs):
	return {
	"parser": get_parser,
	"weight": 10,
	"mime_types": {
	"application/msword": ".doc",
	"application/vnd.openxmlformats-officedocument.wordprocessingml.document": ".docx",
	"application/vnd.ms-excel": ".xls",
	"application/vnd.openxmlformats-officedocument.spreadsheetml.sheet": ".xlsx",
	"application/vnd.ms-powerpoint": ".ppt",
	"application/vnd.openxmlformats-officedocument.presentationml.presentation": ".pptx",
	"application/vnd.openxmlformats-officedocument.presentationml.slideshow": ".ppsx",
	"application/vnd.oasis.opendocument.presentation": ".odp",
	"application/vnd.oasis.opendocument.spreadsheet": ".ods",
	"application/vnd.oasis.opendocument.text": ".odt",
	"text/rtf": ".rtf",
	},
	}

As you can see html is simply not listed as a compatible mime-type, so it's rejected.

[github-actions[bot]]

This discussion has been automatically closed because it was marked as answered. Please see our contributing guidelines for more details.