A B C D E F G H I J K L M N O P Q R S T U V W X Z
All Classes All Packages
All Classes All Packages
All Classes All Packages
A
- ACCEPT - de.pangaea.metadataportal.config.FilterConfig.FilterType
- add(String) - Method in class de.pangaea.metadataportal.utils.HugeStringHashBuilder
-
Adds a String
- add(String, Object) - Method in class de.pangaea.metadataportal.utils.KeyValuePairs
- add(String, Object...) - Method in class de.pangaea.metadataportal.utils.KeyValuePairs
- addAlias(String, String) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
-
Adds alias to index.
- addDocument(MetadataDocument) - Method in class de.pangaea.metadataportal.harvester.Harvester
-
Adds a document to the
Harvester.processor
working in the background. - addDocument(MetadataDocument) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
- addDocument(MetadataDocument) - Method in class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
- addDocument(MetadataDocument) - Method in class de.pangaea.metadataportal.processor.DocumentProcessor
- addDocument(String, long, Source) - Method in class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
-
Adds a document to the
Harvester.processor
working in the background. - addDocument(String, Instant, Source) - Method in class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
-
Adds a document to the
Harvester.processor
working in the background. - addDocument(String, Instant, Source) - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
- addDoNothing(String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Adds a dummy rule for element paths, that are allowed, but not parsed.
- addEsAddress(String) - Method in class de.pangaea.metadataportal.config.Config
-
Deprecated.
- addField(FieldConfig) - Method in class de.pangaea.metadataportal.config.Config
- addField(KeyValuePairs, FieldConfig, String) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Helper method to add a field in the correct format to given
XContentBuilder
. - addFields(KeyValuePairs) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Helper method that adds all fields to the given
XContentBuilder
instance. - addFilter(FilterConfig) - Method in class de.pangaea.metadataportal.config.Config
- addGlobalHarvesterProperty(String) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
-
Deprecated.
- addHarvester(HarvesterConfig) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
-
Adds harvester.
- addHarvesterProperty(String) - Method in class de.pangaea.metadataportal.config.HarvesterConfig
-
Deprecated.
- addSet(String) - Method in class de.pangaea.metadataportal.harvester.OAIMetadataDocument
-
Adds an OAI set to the set
Set
. - addSystemVariables(Map<QName, Object>) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Helper method to register all standard variables for the XPath/Templates evaluation.
- addTargetIndex(TargetIndexConfig) - Method in class de.pangaea.metadataportal.config.Config
- addVariable(VariableConfig) - Method in class de.pangaea.metadataportal.config.Config
- aliases - Variable in class de.pangaea.metadataportal.config.TargetIndexConfig
- ATTRIBUTE_ELEMENT_PREFIX - Static variable in class de.pangaea.metadataportal.utils.XMLToKeyValuePairs
-
If an element has a local name with this prefix, it is converted to a JSON attribute, prefixed by
@
. - authorizationHeader - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
the authorizationHeader from configuration
B
- BackgroundFailure - Exception in de.pangaea.metadataportal.processor
-
DocumentProcessor
throws this exception, if an error occurs in the processing threads. - BackgroundFailure(Throwable) - Constructor for exception de.pangaea.metadataportal.processor.BackgroundFailure
- BASE_VARIABLES - Static variable in class de.pangaea.metadataportal.processor.XPathResolverImpl
- begin(String, String, Attributes) - Method in class de.pangaea.metadataportal.harvester.OAIMetadataSaxRule
- begin(String, String, Attributes) - Method in class de.pangaea.metadataportal.utils.ElementNameCallParamRule
- begin(String, String, Attributes) - Method in class de.pangaea.metadataportal.utils.SaxRule
- BOOLEAN - de.pangaea.metadataportal.config.FieldConfig.DataType
- BooleanParser - Class in de.pangaea.metadataportal.utils
-
BooleanParser
is a simple static class supplying a method to parse booleans. - build() - Method in class de.pangaea.metadataportal.utils.HugeStringHashBuilder
-
Builds a read only set.
- buildDocumentAction(MetadataDocument) - Method in class de.pangaea.metadataportal.processor.DocumentProcessor
-
Processes the given
MetadataDocument
and returns theDocWriteRequest
to pass to Elasticsearch (can either beIndexRequest
orDeleteRequest
).
C
- cancelMissingDocumentDelete() - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
Disable the property "deleteMissingDocuments" for this instance.
- cancelMissingDocumentDelete() - Method in class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
-
disable the property "deleteMissingDocuments" for this instance.
- characters(char[], int, int) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
- check() - Method in class de.pangaea.metadataportal.config.HarvesterConfig
-
Checks, if configuration is ok.
- check() - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
-
Checks, if configuration is ok.
- checked - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
- clear() - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
- client() - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
- close() - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
- close() - Method in class de.pangaea.metadataportal.processor.MinimalTransportClient
- close() - Method in class de.pangaea.metadataportal.utils.NoCloseInputStream
- close(boolean) - Method in class de.pangaea.metadataportal.harvester.ElasticsearchHarvester
- close(boolean) - Method in class de.pangaea.metadataportal.harvester.Harvester
-
Closes harvester.
- close(boolean) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
- close(boolean) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
- close(boolean) - Method in class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
- close(boolean) - Method in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
- close(boolean) - Method in class de.pangaea.metadataportal.harvester.Rebuilder
- close(boolean) - Method in class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
- close(Set<String>) - Method in class de.pangaea.metadataportal.processor.DocumentProcessor
- closeIndex(TargetIndexConfig, String, boolean) - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
-
Closes the index after harvesting and update the aliases to point to the active index.
- commitAndClose() - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
- Config - Class in de.pangaea.metadataportal.config
-
Main panFMP configuration class.
- Config(String) - Constructor for class de.pangaea.metadataportal.config.Config
- Config(Path) - Constructor for class de.pangaea.metadataportal.config.Config
- convertChilds(Node) - Method in class de.pangaea.metadataportal.utils.XMLToKeyValuePairs
-
Convert all children of a node: It first checks if all child nodes are text-only, in that case the whole node is returned as String (using
Node.getTextContent()
. - createEmptyKeyValuePairs() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Helper method that generates an empty
XContentBuilder
instance. - createIndex(TargetIndexConfig, boolean) - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
-
Creates the index (if needed), configures it (mapping), and creates aliases.
- createMetadataDocumentInstance() - Method in class de.pangaea.metadataportal.harvester.Harvester
-
Creates an instance of MetadataDocument and initializes it with the harvester config.
- createMetadataDocumentInstance() - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
- createMetadataDocumentInstance() - Method in class de.pangaea.metadataportal.harvester.Rebuilder
- createMetadataDocumentInstance() - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
- currentNamespaceMap - Variable in class de.pangaea.metadataportal.utils.ExtendedDigester
- custContentHandler - Variable in class de.pangaea.metadataportal.utils.ExtendedDigester
D
- datatype - Variable in class de.pangaea.metadataportal.config.FieldConfig
- datestamp - Variable in class de.pangaea.metadataportal.processor.MetadataDocument
- DATETIME - de.pangaea.metadataportal.config.FieldConfig.DataType
- dbf - Static variable in class de.pangaea.metadataportal.utils.StaticFactories
- de.pangaea.metadataportal - package de.pangaea.metadataportal
-
This is the root package of panFMP.
- de.pangaea.metadataportal.config - package de.pangaea.metadataportal.config
-
This package provides classes and methods for panFMP's configuration (
config.xml
). - de.pangaea.metadataportal.harvester - package de.pangaea.metadataportal.harvester
-
This package provides panFMP's harvesters and their corresponding classes.
- de.pangaea.metadataportal.processor - package de.pangaea.metadataportal.processor
-
This package provides panFMP's document processor (used to parse and transform documents for indexing with Elasticsearch) and corresponding classes.
- de.pangaea.metadataportal.push - package de.pangaea.metadataportal.push
-
This package contains a simple HTTP server to push XML documents to index panFMP.
- de.pangaea.metadataportal.utils - package de.pangaea.metadataportal.utils
-
This package provides utility classes for panFMP.
- DEFAULT_BULK_MEMORY - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
- DEFAULT_BULK_SIZE - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
- DEFAULT_CONCURRENT_BULK_REQUESTS - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
- DEFAULT_CONTENT_TYPE - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
- DEFAULT_DELETE_UNSEEN_BULK_SIZE - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
- DEFAULT_MAX_QUEUE - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
- DEFAULT_NUM_THREADS - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
- DEFAULT_RETRY_COUNT - Static variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
- DEFAULT_RETRY_COUNT - Static variable in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
- DEFAULT_RETRY_COUNT - Static variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
- DEFAULT_RETRY_TIME - Static variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
- DEFAULT_RETRY_TIME - Static variable in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
- DEFAULT_RETRY_TIME - Static variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
- DEFAULT_TIMEOUT - Static variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
- DEFAULT_TIMEOUT - Static variable in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
- DEFAULT_TIMEOUT - Static variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
- defaultValue - Variable in class de.pangaea.metadataportal.config.FieldConfig
- deleted - Variable in class de.pangaea.metadataportal.processor.MetadataDocument
- deleteDocument(String) - Method in class de.pangaea.metadataportal.harvester.Harvester
-
Queues the given ID for deletion.
- deleteDocument(String) - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
- DELETEDOCUMENT - de.pangaea.metadataportal.processor.DocumentErrorAction
- deleteMissingDocuments - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
If enabled, on any kind of full harvesting it will track all valid identifiers and delete all of them not seen in index.
- DENY - de.pangaea.metadataportal.config.FilterConfig.FilterType
- destContentHandler - Variable in class de.pangaea.metadataportal.utils.SaxRule
- DirectoryHarvester - Class in de.pangaea.metadataportal.harvester
-
Harvester for traversing file system directories.
- DirectoryHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.DirectoryHarvester
- DOCUMENT_PROCESSOR_NAMESPACE - Static variable in class de.pangaea.metadataportal.processor.XPathResolverImpl
- DocumentErrorAction - Enum in de.pangaea.metadataportal.processor
-
Enumeration that specifies what action should be taken on a document error.
- DocumentProcessor - Class in de.pangaea.metadataportal.processor
-
Component of panFMP that analyzes and indexes harvested documents in a thread pool.
- doError(String, String) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
-
Deprecated.
- dombuilder - Static variable in class de.pangaea.metadataportal.utils.StaticFactories
- DoNothingRule() - Constructor for class de.pangaea.metadataportal.utils.ExtendedDigester.DoNothingRule
- doParse(Supplier<ExtendedDigester>, String, AtomicReference<Instant>) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
Harvests a URL using the suplied digester.
E
- ELASTICSEARCH_DEFAULT_PORT - Static variable in class de.pangaea.metadataportal.processor.ElasticsearchConnection
- ElasticsearchConnection - Class in de.pangaea.metadataportal.processor
-
TODO
- ElasticsearchConnection(Config) - Constructor for class de.pangaea.metadataportal.processor.ElasticsearchConnection
- ElasticsearchHarvester - Class in de.pangaea.metadataportal.harvester
-
TODO
- ElasticsearchHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.ElasticsearchHarvester
- ElementNameCallParamRule - Class in de.pangaea.metadataportal.utils
-
Similar to digester's
PathCallParamRule
, but puts only the element name of the match onto the parameter stack. - ElementNameCallParamRule(int) - Constructor for class de.pangaea.metadataportal.utils.ElementNameCallParamRule
- emptyRule() - Static method in class de.pangaea.metadataportal.utils.SaxRule
-
Creates an empty "useless" SaxRule.
- enableMissingDocumentDelete() - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
Enable unseen document deletes.
- end(String, String) - Method in class de.pangaea.metadataportal.harvester.OAIMetadataSaxRule
- end(String, String) - Method in class de.pangaea.metadataportal.utils.SaxRule
- endElement(String, String, String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
- endPrefixMapping(String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
- enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.DirectoryHarvester
- enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.ElasticsearchHarvester
- enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.Harvester
-
This method is used by subclasses to enumerate all available harvester properties that are implemented by them.
- enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
- enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
- enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
- enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
- enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.Rebuilder
- enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
- enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
- enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.ZipFileHarvester
- enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
- error(TransformerException) - Method in class de.pangaea.metadataportal.utils.LoggingErrorListener
-
Just throws
e
. - error(SAXParseException) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Just throws
ex
. - esMapping - Variable in class de.pangaea.metadataportal.config.Config
- esMappingFile - Variable in class de.pangaea.metadataportal.config.Config
- esSettings - Variable in class de.pangaea.metadataportal.config.Config
- esTransports - Variable in class de.pangaea.metadataportal.config.Config
- evaluateTemplate(ExpressionConfig) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Helper method to evaluate a template.
- evaluateTemplateAsXHTML(FieldConfig) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Helper method to evaluate a template and return result as XHTML.
- excludeNamespaces - Variable in class de.pangaea.metadataportal.utils.SaxRule
- ExpressionConfig - Class in de.pangaea.metadataportal.config
-
Generic XPath/XSLT config element.
- ExpressionConfig() - Constructor for class de.pangaea.metadataportal.config.ExpressionConfig
- ExtendedDigester - Class in de.pangaea.metadataportal.utils
-
Extension of the Commons Digester Class, that works around some limitations/bugs.
- ExtendedDigester() - Constructor for class de.pangaea.metadataportal.utils.ExtendedDigester
- ExtendedDigester.DoNothingRule - Class in de.pangaea.metadataportal.utils
-
This rule does nothing.
F
- fatalError(TransformerException) - Method in class de.pangaea.metadataportal.utils.LoggingErrorListener
-
Just throws
e
. - fatalError(SAXParseException) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Just throws
ex
. - FieldConfig - Class in de.pangaea.metadataportal.config
-
Config element that contains the definition of a field.
- FieldConfig() - Constructor for class de.pangaea.metadataportal.config.FieldConfig
- FieldConfig.DataType - Enum in de.pangaea.metadataportal.config
- FIELDNAME_CONTENT - Static variable in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
- FIELDNAME_DATESTAMP - Static variable in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
- FIELDNAME_IDENTIFIER - Static variable in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
- FIELDNAME_XML - Static variable in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
- fieldnameDatestamp - Variable in class de.pangaea.metadataportal.config.Config
- fieldnameSource - Variable in class de.pangaea.metadataportal.config.Config
- fieldnameXML - Variable in class de.pangaea.metadataportal.config.Config
- fields - Variable in class de.pangaea.metadataportal.config.Config
- file - Variable in class de.pangaea.metadataportal.config.Config
- FilterConfig - Class in de.pangaea.metadataportal.config
-
A filter config element that filters harvested documents by a XPath expression that returns a
XPathConstants.BOOLEAN
value. - FilterConfig() - Constructor for class de.pangaea.metadataportal.config.FilterConfig
- FilterConfig.FilterType - Enum in de.pangaea.metadataportal.config
- filterDefault - Variable in class de.pangaea.metadataportal.config.Config
- filterIncomingSets - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
The harvester should filter incoming documents according to its set metadata.
- filters - Variable in class de.pangaea.metadataportal.config.Config
- finalizeKeyValuePairs(KeyValuePairs) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Helper method that finalizes the JSON document
- finishDocument() - Method in class de.pangaea.metadataportal.utils.SaxRule
-
Closes the elements created in
initDocument()
. - finishReindex(boolean) - Method in class de.pangaea.metadataportal.harvester.Harvester
-
Does cleanup work after rebuilding the index by
Rebuilder
. - finishReindex(boolean) - Method in class de.pangaea.metadataportal.harvester.Rebuilder
- finishReindex(boolean) - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
- finishTransformation() - Method in class de.pangaea.metadataportal.processor.MetadataDocument.XMLConverter
- formatElasticsearch(TemporalAccessor) - Static method in class de.pangaea.metadataportal.utils.ISODateFormatter
-
Formats an Elasticsearch date.
- formatOAIDate(TemporalAccessor, boolean) - Static method in class de.pangaea.metadataportal.utils.ISODateFormatter
-
Formats an ISO date, according to the OAI granularity.
- fromDateReference - Variable in class de.pangaea.metadataportal.harvester.Harvester
-
Date from which should be harvested (in time reference of the original server)
G
- get() - Static method in class de.pangaea.metadataportal.Package
-
Gets package object from classloader.
- getCause() - Method in exception de.pangaea.metadataportal.harvester.RetryAfterIOException
- getCode() - Method in exception de.pangaea.metadataportal.harvester.OAIException
- getContentHandler() - Method in class de.pangaea.metadataportal.utils.SaxRule
-
return the current
ContentHandler
. - getConverter() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Returns a converter instance that does transformation and validation according to index config.
- getCurrentAssignedPrefixes() - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Returns all current namespace prefix that are assigned.
- getCurrentNamespaceContext(boolean, boolean) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Returns the current
NamespaceContext
for compiling XPath expressions. - getCurrentNamespaceForPrefix(String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Returns the current namespace URI for the given prefix.
- getCurrentNamespaceMap() - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Returns the current namespace prefix mappings as modifiable
Map
containing the prefix and the current namespace assignment (it is just a copy of the internal representation's current mapping). - getCurrentVariableMap() - Method in class de.pangaea.metadataportal.processor.XPathResolverImpl
- getCustomContentHandler() - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Gets the custom event handler.
- getDatestamp() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
- getDebugStream(Log) - Static method in class de.pangaea.metadataportal.utils.LogUtil
-
Returns a PrintStream that logs all output with DEBUG method to the given Commons Logging logger.
- getDecompressingInputStream(HttpResponse<InputStream>) - Static method in class de.pangaea.metadataportal.utils.HttpClientUtils
-
Returns an InputStream which decodes with header "Content-Encoding"
- getDefault() - Method in class de.pangaea.metadataportal.config.FieldConfig
- getDocumentProcessor(HarvesterConfig, String) - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
- getEntityResolver(EntityResolver) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
Returns an
EntityResolver
that resolves all HTTP-URLS usingOAIHarvesterBase.getInputSource(java.net.URI, java.util.concurrent.atomic.AtomicReference<java.time.Instant>)
. - getErrorHandler() - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Not supported, always returns
null
- getErrorStream(Log) - Static method in class de.pangaea.metadataportal.utils.LogUtil
-
Returns a PrintStream that logs all output with ERROR method to the given Commons Logging logger.
- getFatalStream(Log) - Static method in class de.pangaea.metadataportal.utils.LogUtil
-
Returns a PrintStream that logs all output with FATAL method to the given Commons Logging logger.
- getFinalDOM() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Returns XML contents as DOM tree.
- getFullPackageDescription() - Static method in class de.pangaea.metadataportal.Package
-
Gets a version string to print out.
- getIdentifier() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
- getInfoStream(Log) - Static method in class de.pangaea.metadataportal.utils.LogUtil
-
Returns a PrintStream that logs all output with INFO method to the given Commons Logging logger.
- getInputSource(URI, AtomicReference<Instant>) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
Returns a SAX
InputSource
for retrieving stream data of an URL. - getInstance() - Static method in class de.pangaea.metadataportal.processor.XPathResolverImpl
- getKeyValuePairs() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Converts this instance to a Elasticsearch JSON node
- getMessage() - Method in exception de.pangaea.metadataportal.harvester.OAIException
- getMetadataDocumentFactory() - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
Returns a factory for creating the
MetadataDocument
s in Digester code (usingFactoryCreateRule
). - getName() - Method in class de.pangaea.metadataportal.config.FieldConfig
- getProductName() - Static method in class de.pangaea.metadataportal.Package
-
Gets product name ("panFMP").
- getProductVendor() - Static method in class de.pangaea.metadataportal.Package
-
Gets product vendor (the developer team).
- getRawIndexName(boolean) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
- getRetryAfter() - Method in exception de.pangaea.metadataportal.harvester.RetryAfterIOException
- getSets() - Method in class de.pangaea.metadataportal.harvester.OAIMetadataDocument
-
Returns all OAI sets as
Set
. - getTraceStream(Log) - Static method in class de.pangaea.metadataportal.utils.LogUtil
-
Returns a PrintStream that logs all output with TRACE method to the given Commons Logging logger.
- getTransformContentHandler() - Method in class de.pangaea.metadataportal.processor.MetadataDocument.XMLConverter
- getValidHarvesterPropertyNames() - Method in class de.pangaea.metadataportal.harvester.Harvester
-
Return the
Set
of harvester property names that this harvester supports. - getVersion() - Static method in class de.pangaea.metadataportal.Package
-
Gets version of panFMP.
- getWarnStream(Log) - Static method in class de.pangaea.metadataportal.utils.LogUtil
-
Returns a PrintStream that logs all output with WARN method to the given Commons Logging logger.
- getXML() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Returns XML contents as String (a cache is used).
- globalHarvesterProperties - Variable in class de.pangaea.metadataportal.config.TargetIndexConfig
H
- haltOnSchemaError - Variable in class de.pangaea.metadataportal.config.Config
- harvest() - Method in class de.pangaea.metadataportal.harvester.DirectoryHarvester
- harvest() - Method in class de.pangaea.metadataportal.harvester.ElasticsearchHarvester
- harvest() - Method in class de.pangaea.metadataportal.harvester.Harvester
-
This method is called by the harvester after
Harvester.open(de.pangaea.metadataportal.processor.ElasticsearchConnection, java.lang.String)
'ing it. - harvest() - Method in class de.pangaea.metadataportal.harvester.NoOpHarvester
- harvest() - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
- harvest() - Method in class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
- harvest() - Method in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
- harvest() - Method in class de.pangaea.metadataportal.harvester.Rebuilder
- harvest() - Method in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
- harvest() - Method in class de.pangaea.metadataportal.harvester.ZipFileHarvester
- harvest() - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
- harvestCount - Variable in class de.pangaea.metadataportal.harvester.Harvester
-
Count of harvested documents.
- Harvester - Class in de.pangaea.metadataportal.harvester
-
Harvester interface to panFMP.
- Harvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.Harvester
-
Default constructor.
- HARVESTER_METADATA_FIELD_LAST_HARVESTED - Static variable in class de.pangaea.metadataportal.harvester.Harvester
- HARVESTER_METADATA_TYPE - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
- harvesterClass - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
- HarvesterConfig - Class in de.pangaea.metadataportal.config
-
Configuration of a panFMP harvester.
- HarvesterConfig(Config, TargetIndexConfig, String) - Constructor for class de.pangaea.metadataportal.config.HarvesterConfig
-
Default constructor
- harvesterMetadata - Variable in class de.pangaea.metadataportal.processor.DocumentProcessor
- harvesters - Variable in class de.pangaea.metadataportal.config.TargetIndexConfig
- harvestersAndIndexes - Variable in class de.pangaea.metadataportal.config.Config
- harvestMessageStep - Variable in class de.pangaea.metadataportal.harvester.Harvester
-
Step at which
Harvester.addDocument(de.pangaea.metadataportal.processor.MetadataDocument)
prints log messages. - HostAndPort - Class in de.pangaea.metadataportal.utils
-
Simple static class to parse
host:port
combinations. - HTML_CONTENT_TYPES - Static variable in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
- HTML_SAX_PARSER_CLASS - Static variable in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
-
This is the parser class used to parse HTML documents to collect URLs for crawling.
- httpClient - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
HttpClient to use, configured with correct connect timeout.
- HttpClientUtils - Class in de.pangaea.metadataportal.utils
-
Some utility methods for decompressing
HttpResponse
- HugeStringHashBuilder - Class in de.pangaea.metadataportal.utils
-
A utility class that uses Lucene's
BytesRefHash
to create aSet
. - HugeStringHashBuilder() - Constructor for class de.pangaea.metadataportal.utils.HugeStringHashBuilder
I
- iconfig - Variable in class de.pangaea.metadataportal.harvester.Harvester
-
Harvester configuration
- iconfig - Variable in class de.pangaea.metadataportal.processor.MetadataDocument
-
The harvester configuration.
- id - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
- identifier - Variable in class de.pangaea.metadataportal.processor.MetadataDocument
- identifierPrefix - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
prepend all identifiers returned by OAI with this string
- ignorableWhitespace(char[], int, int) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
- ignoreDatestamps - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
If enabled, does full harvesting, while ignoring all datestamps (default is
false
). - IGNOREDOCUMENT - de.pangaea.metadataportal.processor.DocumentErrorAction
- indexName - Variable in class de.pangaea.metadataportal.config.TargetIndexConfig
- indexSettings - Variable in class de.pangaea.metadataportal.config.TargetIndexConfig
- initDocument() - Method in class de.pangaea.metadataportal.utils.SaxRule
-
Add some elements when document started.
- initializeWrapper(Config, String, Consumer<PushWrapperHarvester>) - Static method in class de.pangaea.metadataportal.push.PushWrapperHarvester
- initVariables() - Method in class de.pangaea.metadataportal.processor.XPathResolverImpl
- INTEGER - de.pangaea.metadataportal.config.FieldConfig.DataType
- isAllIndexes(String) - Static method in class de.pangaea.metadataportal.harvester.Harvester
- isClosed() - Method in class de.pangaea.metadataportal.harvester.Harvester
-
Checks if harvester is closed.
- isClosed() - Method in class de.pangaea.metadataportal.processor.DocumentProcessor
- isDeleted() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Returns deletion status.
- isDocumentOutdated(Instant) - Method in class de.pangaea.metadataportal.harvester.Harvester
-
Checks, if the supplied Datestamp needs harvesting.
- isEmpty() - Method in class de.pangaea.metadataportal.utils.KeyValuePairs
- isEnabled() - Method in class de.pangaea.metadataportal.harvester.OAIMetadataSaxRule
- isFailed() - Method in class de.pangaea.metadataportal.processor.DocumentProcessor
- ISODateFormatter - Class in de.pangaea.metadataportal.utils
-
Simple static class to create and parse ISO-8601 date stamps (used by OAI harvester): The used date formats are: Long date:
uuuu-MM-dd'T'HH:mm:ss'Z'
Short date:uuuu-MM-dd
- isValidHarvesterId(Config, String) - Static method in class de.pangaea.metadataportal.push.PushWrapperHarvester
J
- JSON - de.pangaea.metadataportal.config.FieldConfig.DataType
K
- KeyValuePairs - Class in de.pangaea.metadataportal.utils
-
Key/Value pairs used to build JSON.
- KeyValuePairs() - Constructor for class de.pangaea.metadataportal.utils.KeyValuePairs
L
- LenientDateParser - Class in de.pangaea.metadataportal.utils
-
Simple static class to parse date/times very lenient.
- loadFromElasticSearchHit(SearchHit) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
"Harvests" a Elasticsearch
SearchHit
from index for re-parsing. - log - Variable in class de.pangaea.metadataportal.harvester.Harvester
-
Logger instance (shared by all subclasses).
- LoggingErrorListener - Class in de.pangaea.metadataportal.utils
-
Helper class to correctly log
TransformerException
s with Commons Logging. - LoggingErrorListener(Class<?>) - Constructor for class de.pangaea.metadataportal.utils.LoggingErrorListener
-
A error listener using the supplied class name as log target.
- LoggingErrorListener(Log) - Constructor for class de.pangaea.metadataportal.utils.LoggingErrorListener
-
A error listener using the supplied Commons Logging instance as log target.
- LogUtil - Class in de.pangaea.metadataportal.utils
-
Simple static class that supplies
PrintStream
s for log methods.
M
- main(String[]) - Static method in class de.pangaea.metadataportal.harvester.Harvester
-
External entry point to the harvester interface.
- main(String[]) - Static method in class de.pangaea.metadataportal.harvester.Rebuilder
- main(String[]) - Static method in class de.pangaea.metadataportal.harvester.UpdateAliases
- main(String...) - Static method in class de.pangaea.metadataportal.push.PushServer
- main(String[]) - Static method in class de.pangaea.metadataportal.utils.LenientDateParser
-
For testing the parser from command line.
- makePathAbsolute(String) - Method in class de.pangaea.metadataportal.config.Config
-
makes the given local filesystem path absolute and resolve it relative to config directory
- makePathAbsolute(String, boolean) - Method in class de.pangaea.metadataportal.config.Config
-
makes the given local filesystem path or URL absolute and resolve it relative to config directory (if local)
- MetadataDocument - Class in de.pangaea.metadataportal.processor
-
This class holds all information harvested and provides methods for
DocumentProcessor
to create aXContentBuilder
instance from it. - MetadataDocument(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.processor.MetadataDocument
-
Constructor, that creates an empty instance for the supplied index configuration.
- MetadataDocument.XMLConverter - Class in de.pangaea.metadataportal.processor
-
This class handles the transformation from any source to the "official" metadata format and can even validate it
- metadataPrefix - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
the used metadata prefix from the configuration
- MinimalTransportClient - Class in de.pangaea.metadataportal.processor
-
This is a minimalistic
TransportClient
using Netty 4 only. - MinimalTransportClient(Settings, Class<? extends Plugin>...) - Constructor for class de.pangaea.metadataportal.processor.MinimalTransportClient
-
Creates a new transport client with pre-installed plugins.
- MinimalTransportClient(Settings, Collection<Class<? extends Plugin>>) - Constructor for class de.pangaea.metadataportal.processor.MinimalTransportClient
-
Creates a new transport client with pre-installed plugins.
- MinimalTransportClient(Settings, Collection<Class<? extends Plugin>>, TransportClient.HostFailureListener) - Constructor for class de.pangaea.metadataportal.processor.MinimalTransportClient
-
Creates a new transport client with pre-installed plugins.
N
- name - Variable in class de.pangaea.metadataportal.config.FieldConfig
- name - Variable in class de.pangaea.metadataportal.config.VariableConfig
- NoCloseInputStream - Class in de.pangaea.metadataportal.utils
- NoCloseInputStream(InputStream) - Constructor for class de.pangaea.metadataportal.utils.NoCloseInputStream
- NoOpHarvester - Class in de.pangaea.metadataportal.harvester
-
This harvester can be used to 'disable' harvesting from a source, e.g.
- NoOpHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.NoOpHarvester
- NUMBER - de.pangaea.metadataportal.config.FieldConfig.DataType
O
- OAI_NS - Static variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
- OAI_STATICREPOSITORY_NS - Static variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
- OAIException - Exception in de.pangaea.metadataportal.harvester
-
This exception is thrown on an OAI protocol error, which is triggered by an
<error>
response from the repository. - OAIException(String, String) - Constructor for exception de.pangaea.metadataportal.harvester.OAIException
- OAIHarvester - Class in de.pangaea.metadataportal.harvester
-
Harvester for OAI-PMH repositories.
- OAIHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.OAIHarvester
- OAIHarvesterBase - Class in de.pangaea.metadataportal.harvester
-
Abstract base class for OAI harvesting support in panFMP.
- OAIHarvesterBase(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.OAIHarvesterBase
- OAIMetadataDocument - Class in de.pangaea.metadataportal.harvester
-
Special implementation of
MetadataDocument
that adds OAI set support to internal fields - OAIMetadataDocument(HarvesterConfig, String, boolean) - Constructor for class de.pangaea.metadataportal.harvester.OAIMetadataDocument
-
Constructor, that creates an empty instance for the supplied index configuration.
- OAIMetadataSaxRule - Class in de.pangaea.metadataportal.harvester
-
This class is used as a rule for the "metadata" element of the OAI response.
- OAIMetadataSaxRule() - Constructor for class de.pangaea.metadataportal.harvester.OAIMetadataSaxRule
-
Creates a new rule which is enabled by default.
- OAIStaticRepositoryHarvester - Class in de.pangaea.metadataportal.harvester
-
Harvester for OAI static repositories.
- OAIStaticRepositoryHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
- open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.DirectoryHarvester
- open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.ElasticsearchHarvester
- open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.Harvester
-
Opens harvester for harvesting documents described by the given
HarvesterConfig
. - open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
- open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
- open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
- open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.Rebuilder
- open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.ZipFileHarvester
- open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
P
- Package - Class in de.pangaea.metadataportal
-
Class to get version information about panFMP.
- PanFMP1IndexHarvester - Class in de.pangaea.metadataportal.harvester
-
This harvester supports replication XML contents from a legacy panFMP 1.x installation.
- PanFMP1IndexHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
- parent - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
- parse(String, int) - Static method in class de.pangaea.metadataportal.utils.HostAndPort
-
Parses the given string to a
InetSocketTransportAddress
. - parseBoolean(String) - Static method in class de.pangaea.metadataportal.utils.BooleanParser
-
Parses a boolean value expressed as String
- parseDate(String) - Static method in class de.pangaea.metadataportal.utils.LenientDateParser
-
Parses a string to a
Date
- parseLexicalQName(String, NamespaceContext) - Static method in class de.pangaea.metadataportal.utils.QNameParser
-
Parses the given string to a
QName
. - parseOAIDate(String) - Static method in class de.pangaea.metadataportal.utils.ISODateFormatter
-
Parses the given string from the OAI protocol into an
Instant
. - prepareReindex(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.Harvester
-
Prepares harvester for rebuilding the index by
Rebuilder
. - prepareReindex(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.Rebuilder
- prepareReindex(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
- processFilters() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Helper method that evaluates all filters.
- processingInstruction(String, String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
- processor - Variable in class de.pangaea.metadataportal.harvester.Harvester
-
Instance of
DocumentProcessor
that converts and updates the Elasticsearch instance in other threads. - processXPathVariables() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Helper method to process all user supplied variables for the XPath/Templates evaluation.
- properties - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
- PublicForDigesterUse - Annotation Type in de.pangaea.metadataportal.utils
-
This annotation is used to mark methods/classes that are only declared
public
for use byDigester
but are not intended to be public. - PushServer - Class in de.pangaea.metadataportal.push
-
Provides a simple HTTP server that accepts push requests.
- PushServer(Config, String, int, String) - Constructor for class de.pangaea.metadataportal.push.PushServer
- PushWrapperHarvester - Class in de.pangaea.metadataportal.push
-
Fake
Harvester
class to implement byPushServer
. - PushWrapperHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.push.PushWrapperHarvester
Q
- QNameParser - Class in de.pangaea.metadataportal.utils
-
Simple static class to parse XPath-like string QNames ("prefix:tagname").
R
- Rebuilder - Class in de.pangaea.metadataportal.harvester
-
Index rebuilder implemented as harvester that reads all documents from an index and pushes them back into the index.
- Rebuilder(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.Rebuilder
- recreateDigester() - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
- recreateDigester() - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
Recreates all digesters that are used by parsing the OAI XML.
- recreateDigester() - Method in class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
- replayEndPrefixMappings(ContentHandler, Set<String>) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Replays all current prefix mappings for another
ContentHandler
(end mapping). - replayStartPrefixMappings(ContentHandler, Set<String>) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Replays all current prefix mappings for another
ContentHandler
(start mapping). - reset() - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
- reset() - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
Resets the internal variables.
- resolveFunction(QName, int) - Method in class de.pangaea.metadataportal.processor.XPathResolverImpl
- resolveVariable(QName) - Method in class de.pangaea.metadataportal.processor.XPathResolverImpl
- RetryAfterIOException - Exception in de.pangaea.metadataportal.harvester
-
Thrown when HTTP server responds with
HttpURLConnection.HTTP_UNAVAILABLE
. - RetryAfterIOException(int, IOException) - Constructor for exception de.pangaea.metadataportal.harvester.RetryAfterIOException
- RetryAfterIOException(int, String) - Constructor for exception de.pangaea.metadataportal.harvester.RetryAfterIOException
- RetryAfterIOException(int, String, IOException) - Constructor for exception de.pangaea.metadataportal.harvester.RetryAfterIOException
- retryCount - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
the retryCount from configuration
- retryCount - Variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
-
the retryCount from configuration
- retryTime - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
the retryTime from configuration
- retryTime - Variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
-
the retryTime from configuration
- root - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
- root - Variable in class de.pangaea.metadataportal.config.TargetIndexConfig
- runHarvester(Config, String) - Static method in class de.pangaea.metadataportal.harvester.Harvester
-
Harvests one (
harvesterId='name'
) or more (harvesterId='*'
) sources. - runHarvester(Config, String, Class<? extends Harvester>) - Static method in class de.pangaea.metadataportal.harvester.Harvester
-
Harvests one (
harvesterId="name"
) or more (harvesterId="*"/"all"/null
) sources. - runRebuilder(Config, String) - Static method in class de.pangaea.metadataportal.harvester.Rebuilder
- runUpdateAliases(Config, String) - Static method in class de.pangaea.metadataportal.harvester.UpdateAliases
S
- saxFactory - Static variable in class de.pangaea.metadataportal.utils.StaticFactories
- SaxRule - Class in de.pangaea.metadataportal.utils
-
This class is used as a rule for included documents during
Digester
parsing. - SaxRule() - Constructor for class de.pangaea.metadataportal.utils.SaxRule
-
Default constructor
- schema - Variable in class de.pangaea.metadataportal.config.Config
- sendCompressionHeaders(HttpRequest.Builder) - Static method in class de.pangaea.metadataportal.utils.HttpClientUtils
-
Sends "Accept-Encoding" header to ask server to compress result.
- sendHttpRequestWithRetry(HttpClient, HttpRequest, HttpResponse.BodyHandler<T>) - Static method in class de.pangaea.metadataportal.utils.HttpClientUtils
-
Workaround for: https://stackoverflow.com/questions/55087292/how-to-handle-http-2-goaway-with-httpclient
- serializeToContentBuilder(XContentBuilder) - Method in class de.pangaea.metadataportal.utils.KeyValuePairs
-
Serializes the object to a sequence of fields.
- setAugmentation(String) - Method in class de.pangaea.metadataportal.config.Config
-
Deprecated.
- setContentHandler(ContentHandler) - Method in class de.pangaea.metadataportal.utils.SaxRule
-
Sets the SAX
ContentHandler
that gets all SAX Events after thestartElement
event. - setCustomContentHandler(ContentHandler) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Sets a custom
ContentHandler
, that receives all SAX events until disabled (null
). - setDataType(String) - Method in class de.pangaea.metadataportal.config.FieldConfig
-
Deprecated.
- setDatestamp(Instant) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Set the datestamp (last modification time of document file).
- setDatestampField(String) - Method in class de.pangaea.metadataportal.config.Config
-
Deprecated.
- setDefault(String) - Method in class de.pangaea.metadataportal.config.FieldConfig
- setDeleted(boolean) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Marks a harvested document as deleted.
- setDigester(Digester) - Method in class de.pangaea.metadataportal.utils.SaxRule
-
Set the
Digester
with which thisRule
is associated. - setEnabled(boolean) - Method in class de.pangaea.metadataportal.harvester.OAIMetadataSaxRule
-
If enabled, a DOM tree is build from metadata.
- setErrorHandler(ErrorHandler) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Not suppoted, always throws
IllegalArgumentException
if notnull
. - setEsMappingFile(String) - Method in class de.pangaea.metadataportal.config.Config
-
Deprecated.
- setEsSettings(Settings.Builder) - Method in class de.pangaea.metadataportal.config.Config
-
Deprecated.
- setExcludeNamespaces(Set<String>) - Method in class de.pangaea.metadataportal.utils.SaxRule
-
Sets a
Set<String>
containing all Namespace URIs that should not be feed to the targetContentHandler
on match. - setFilterDefault(String) - Method in class de.pangaea.metadataportal.config.Config
-
Deprecated.
- setFinalDOM(Document) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Sets XML final (transformed) xml contents as DOM tree.
- setGranularity(String) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
-
Deprecated.
- setHaltOnSchemaError(String) - Method in class de.pangaea.metadataportal.config.Config
-
Deprecated.
- setHarvesterClass(String) - Method in class de.pangaea.metadataportal.config.HarvesterConfig
-
Deprecated.
- setHarvestingDateReference(Instant) - Method in class de.pangaea.metadataportal.harvester.Harvester
-
Reference date of this harvesting event (in time reference of the original server).
- setHeaderInfo(String, String, String) - Method in class de.pangaea.metadataportal.harvester.OAIMetadataDocument
-
Deprecated.
- setIdentifier(String) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Set the document identifier.
- setIndexSettings(Settings.Builder) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
-
Deprecated.
- setName(ExtendedDigester, String) - Method in class de.pangaea.metadataportal.config.VariableConfig
-
Deprecated.
- setName(String) - Method in class de.pangaea.metadataportal.config.FieldConfig
- setNameSuffix1(String) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
- setNameSuffix2(String) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
- setRequest(Map<String, String>) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
-
Deprecated.
- setResponseDate(String) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
-
Deprecated.
- setResumptionToken(String, String, String, String) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
-
Deprecated.
- setRulesWithInvalidElementCheck(Rules) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Adds a default Rule for not allowing invalid (not registered) event paths.
- sets - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
the sets to harvest from the configuration,
null
to harvest all - sets - Variable in class de.pangaea.metadataportal.harvester.OAIMetadataDocument
- setSchema(String, String) - Method in class de.pangaea.metadataportal.config.Config
- setSourceField(String) - Method in class de.pangaea.metadataportal.config.Config
-
Deprecated.
- setTemplate(Templates) - Method in class de.pangaea.metadataportal.config.ExpressionConfig
- setTemplate(Templates) - Method in class de.pangaea.metadataportal.config.FilterConfig
- setType(String) - Method in class de.pangaea.metadataportal.config.FilterConfig
-
Deprecated.
- setTypeName(String) - Method in class de.pangaea.metadataportal.config.Config
-
Deprecated.
- setValidIdentifiers(Set<String>) - Method in class de.pangaea.metadataportal.harvester.Harvester
-
Set a set of all "seen" valid identifiers.
- setXMLField(String) - Method in class de.pangaea.metadataportal.config.Config
-
Deprecated.
- setXPath(ExtendedDigester, String) - Method in class de.pangaea.metadataportal.config.ExpressionConfig
-
Deprecated.
- SingleFileEntitiesHarvester - Class in de.pangaea.metadataportal.harvester
-
Abstract harvester class for single file entities (like files from web page or from a local directory).
- SingleFileEntitiesHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
- SingleFileEntitiesHarvester(HarvesterConfig, DocumentErrorAction) - Constructor for class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
- size() - Method in class de.pangaea.metadataportal.utils.KeyValuePairs
- skippedEntity(String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
- startDocument() - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
- startElement(String, String, String, Attributes) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
- startPrefixMapping(String, String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
- StaticFactories - Class in de.pangaea.metadataportal.utils
-
Some pre-allocated XML factories.
- STOP - de.pangaea.metadataportal.processor.DocumentErrorAction
- STRING - de.pangaea.metadataportal.config.FieldConfig.DataType
T
- TargetIndexConfig - Class in de.pangaea.metadataportal.config
-
Configuration of an index in Elasticsearch.
- TargetIndexConfig(Config, String) - Constructor for class de.pangaea.metadataportal.config.TargetIndexConfig
-
Default constructor
- targetIndexes - Variable in class de.pangaea.metadataportal.config.Config
- timeout - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
-
the timeout from configuration
- timeout - Variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
-
the timeout from configuration
- toString() - Method in class de.pangaea.metadataportal.config.ExpressionConfig
- toString() - Method in class de.pangaea.metadataportal.config.FieldConfig
- toString() - Method in class de.pangaea.metadataportal.config.FilterConfig
- toString() - Method in class de.pangaea.metadataportal.config.VariableConfig
- toString() - Method in class de.pangaea.metadataportal.harvester.OAIMetadataDocument
- toString() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
- toString() - Method in class de.pangaea.metadataportal.utils.KeyValuePairs
- transFactory - Static variable in class de.pangaea.metadataportal.utils.StaticFactories
- transform(Source) - Method in class de.pangaea.metadataportal.processor.MetadataDocument.XMLConverter
- type - Variable in class de.pangaea.metadataportal.config.FilterConfig
- typeName - Variable in class de.pangaea.metadataportal.config.Config
U
- unsetVariables() - Method in class de.pangaea.metadataportal.processor.XPathResolverImpl
- updateAliases(TargetIndexConfig) - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
-
Closes the index after harvesting and update the aliases to point to the active index.
- UpdateAliases - Class in de.pangaea.metadataportal.harvester
-
TODO
- UpdateAliases() - Constructor for class de.pangaea.metadataportal.harvester.UpdateAliases
- USER_AGENT - Static variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
- USER_AGENT - Static variable in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
- USER_AGENT - Static variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
V
- validateWithAugmentation - Variable in class de.pangaea.metadataportal.config.Config
- valueOf(String) - Static method in enum de.pangaea.metadataportal.config.FieldConfig.DataType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum de.pangaea.metadataportal.config.FilterConfig.FilterType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum de.pangaea.metadataportal.processor.DocumentErrorAction
-
Returns the enum constant of this type with the specified name.
- values() - Static method in enum de.pangaea.metadataportal.config.FieldConfig.DataType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum de.pangaea.metadataportal.config.FilterConfig.FilterType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum de.pangaea.metadataportal.processor.DocumentErrorAction
-
Returns an array containing the constants of this enum type, in the order they are declared.
- VARIABLE_DOC_DATESTAMP - Static variable in class de.pangaea.metadataportal.processor.XPathResolverImpl
- VARIABLE_DOC_IDENTIFIER - Static variable in class de.pangaea.metadataportal.processor.XPathResolverImpl
- VARIABLE_HARVESTER_ID - Static variable in class de.pangaea.metadataportal.processor.XPathResolverImpl
- VariableConfig - Class in de.pangaea.metadataportal.config
-
A config element that supplies a variable like variables in XPath.
- VariableConfig() - Constructor for class de.pangaea.metadataportal.config.VariableConfig
W
- waitForYellow(TargetIndexConfig) - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
- walkNodeTexts(StringBuilder, Node, boolean) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
-
Helper method to walk through a DOM tree node (n) and collect strings.
- warning(TransformerException) - Method in class de.pangaea.metadataportal.utils.LoggingErrorListener
-
Logs message and location with WARN method.
- warning(SAXParseException) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
-
Logs the SAX exception as warning (with location).
- WebCrawlingHarvester - Class in de.pangaea.metadataportal.harvester
-
Harvester for traversing websites and harvesting XML documents.
- WebCrawlingHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
X
- XHTML - de.pangaea.metadataportal.config.FieldConfig.DataType
- XML - de.pangaea.metadataportal.config.FieldConfig.DataType
- XMLToKeyValuePairs - Class in de.pangaea.metadataportal.utils
-
Used to serialize
Node
from a DOM tree to an Object (mainlyKeyValuePairs
). - XMLToKeyValuePairs(boolean) - Constructor for class de.pangaea.metadataportal.utils.XMLToKeyValuePairs
- xPathExpr - Variable in class de.pangaea.metadataportal.config.ExpressionConfig
- xpathFactory - Static variable in class de.pangaea.metadataportal.utils.StaticFactories
- XPathResolverImpl - Class in de.pangaea.metadataportal.processor
-
Helper class that implements several XPath interfaces to supply variables and functions to XPath expressions.
- xPathVariables - Variable in class de.pangaea.metadataportal.config.Config
- xslt - Variable in class de.pangaea.metadataportal.config.ExpressionConfig
- xslt - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
- xsltParams - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
Z
- ZipFileHarvester - Class in de.pangaea.metadataportal.harvester
-
Harvester for unzipping ZIP files and reading their contents.
- ZipFileHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.ZipFileHarvester
All Classes All Packages