Definition at line 786 of file cgi2rcgi.cpp.
◆ NCBI_DECLARE_WORKERNODE_FACTORY #define NCBI_DECLARE_WORKERNODE_FACTORY ( TWorkerNodeJob, Version ) Value:NCBI_DECLARE_WORKERNODE_FACTORY_IMPL(TWorkerNodeJob, Version)
static struct tagNamedScoreFactory Factory[]
Definition at line 496 of file grid_worker.hpp.
◆ NCBI_DECLARE_WORKERNODE_FACTORY_EX #define NCBI_DECLARE_WORKERNODE_FACTORY_EX ( TWorkerNodeJob, TWorkerNodeIdleTask, Version ) Value:TWorkerNodeJob##FactoryEx; \
NCBI_DECLARE_WORKERNODE_FACTORY_IMPL(TWorkerNodeJob, Version)
Definition at line 500 of file grid_worker.hpp.
◆ NCBI_DECLARE_WORKERNODE_FACTORY_IMPL #define NCBI_DECLARE_WORKERNODE_FACTORY_IMPL ( TWorkerNodeJob, Version ) Value:BEGIN_NCBI_SCOPE \
template <> \
#TWorkerNodeJob " version " NCBI_AS_STRING(Version); \
template <> \
const char* const CSimpleJobFactory<TWorkerNodeJob>::m_AppName = \
#TWorkerNodeJob; \
END_NCBI_SCOPE
Definition at line 486 of file grid_worker.hpp.
◆ CNetScheduleExecuter ◆ TInstance [1/6] ◆ TInstance [2/6] ◆ TInstance [3/6] ◆ TInstance [4/6] ◆ TInstance [5/6] ◆ TInstance [6/6] ◆ TJobMask ◆ TPersistedEntries ◆ TPersistentEntries ◆ TQueueParams ◆ TVersion ◆ EAppRegistry ◆ ECleanUp Enumerator eAutomaticCleanup eManualCleanupDefinition at line 120 of file grid_client.hpp.
◆ EClientType Enumerator eCT_Auto eCT_Admin eCT_Submitter eCT_WorkerNode eCT_ReaderDefinition at line 263 of file netschedule_api.hpp.
◆ ECommitStatus Enumerator eCS_Done eCS_Failure eCS_Return eCS_Reschedule eCS_NotCommitted eCS_JobIsLostDefinition at line 350 of file grid_worker.hpp.
◆ EDisabledRequestEventsDisable the automatic logging of request-start and request-stop events by the framework itself.
Enumerator eEnableStartStop eDisableStartStop eDisableStartOnlyDefinition at line 601 of file grid_worker.hpp.
◆ EErrCode [1/3] ◆ EErrCode [2/3] Enumerator ePortBusy eJobIsLost eJobFactoryIsNotSet eExclusiveModeIsAlreadySetDefinition at line 619 of file grid_worker.hpp.
◆ EErrCode [3/3] Enumerator eInternalError eProtocolSyntaxError eAuthenticationError eKeyFormatError eJobNotFound eGroupNotFound eAffinityNotFound eInvalidJobStatus eUnknownQueue eUnknownQueueClass eUnknownService eTooManyPendingJobs eDataTooLong eInvalidClient eClientDataVersionMismatch eAccessDenied eSubmitsDisabled eShuttingDown eDuplicateName eObsoleteCommand eInvalidParameter eInvalidAuthToken eTooManyPreferredAffinities ePrefAffExpired eTryAgainDefinition at line 66 of file netschedule_api_expt.hpp.
◆ EEvent Enumerator eJobStarted eJobStopped eJobFailed eJobSucceeded eJobReturned eJobRescheduled eJobCanceled eJobLostDefinition at line 510 of file grid_worker.hpp.
◆ EJobAffinityPreferenceAffinity matching modes.
Definition at line 593 of file netschedule_api.hpp.
◆ EJobMaskJob masks.
Enumerator eEmptyMask eExclusiveJobExclusive job - the node executes only this job, even if there are processor resources.
eOutOfOrderThis jobs comes to the node before every regular jobs.
eForEachNodeThis job will be scheduled to every active node.
eSystemJobThis job should be interpreted by client library, not client itself Can contain control information, e.g.
instruction for node to die
eUserMaskUser's masks start from here.
Definition at line 196 of file netschedule_api.hpp.
◆ EJobStatusJob status codes.
Enumerator eJobNotFoundNo such job.
ePendingWaiting for execution.
eRunningRunning on a worker node.
eCanceledExplicitly canceled.
eFailedFailed to run (execution timeout)
eDoneJob is ready (computed successfully)
eReadingJob has its output been reading.
eConfirmedFinal state - read confirmed.
eReadFailedFinal state - read failed.
eDeletedThe job has been wiped out of the database.
eLastStatusFake status (do not use)
Definition at line 160 of file netschedule_api.hpp.
◆ ENetScheduleWarningType Enumerator eWarnUnknown eWarnAffinityNotFound eWarnAffinityNotPreferred eWarnAffinityAlreadyPreferred eWarnGroupNotFound eWarnJobNotFound eWarnJobAlreadyCanceled eWarnJobAlreadyDone eWarnJobAlreadyFailed eWarnJobPassportOnlyMatch eWarnNoParametersChanged eWarnConfigFileNotChanged eWarnAlertNotFound eWarnAlertAlreadyAcknowledged eWarnSubmitsDisabledForServer eWarnQueueAlreadyPaused eWarnQueueNotPaused eWarnCommandObsolete eWarnJobNotReadDefinition at line 273 of file netschedule_api.hpp.
◆ EProgressMsg ◆ EReadNextJobResultPossible outcomes of ReadNextJob() calls.
Enumerator eRNJ_JobReadyA job is returned.
eRNJ_NotReadyNo matching jobs are ready for reading.
eRNJ_Timeout eRNJ_NoMoreJobsNo matching jobs.
eRNJ_InterruptReadNextJob() has been interrupted.
Definition at line 781 of file netschedule_api.hpp.
◆ EWorkerNodeCleanupEventEvent notifying of a safe clean-up point.
It is generated for a job after the job is finished (or the worker node is shutting down). It is also generated for the whole worker node – when it is shutting down.
Enumerator eRegularCleanupFor jobs – run from the same thread after Do() is done; for the whole WN – run from a separate (clean-up) thread after all jobs are done and cleaned up, and the whole worker node is shutting down.
eOnHardExitCalled on emergency shutdown, always from a different (clean-up) thread, even for the jobs.
Definition at line 77 of file grid_worker.hpp.
◆ AddAffinityEntry() void SInputValidator::AddAffinityEntry ( string name ) ◆ AddListener() ◆ AddPreferredAffinities() void CNetScheduleExecutor::AddPreferredAffinities ( const vector< string > & affs_to_add ) inline ◆ AddTagMap() ◆ CallEventHandlers() ◆ CancelJob() [1/2] ◆ CancelJob() [2/2] void CNetScheduleSubmitter::CancelJob ( const string & job_key ) ◆ CancelJobGroup() ◆ CGridCgiContext() [1/3] ◆ CGridCgiContext() [2/3]A copy constructor and an assignment operator are prohibited.
◆ CGridCgiContext() [3/3] ◆ CGridClient() [1/3]Constructor.
Definition at line 52 of file grid_client.cpp.
◆ CGridClient() [2/3]Constructor.
Definition at line 44 of file grid_client.cpp.
◆ CGridClient() [3/3]The copy constructor and the assignment operator are prohibited.
◆ CGridJobBatchSubmitter() [1/2] ◆ CGridJobBatchSubmitter() [2/2]The copy constructor and the assignment operator are prohibited.
◆ CGridWorkerNode() [1/4] CGridWorkerNode::CGridWorkerNode ( ) inlineDefinition at line 540 of file grid_worker.hpp.
◆ CGridWorkerNode() [2/4]Construct a worker node using class factories.
Definition at line 363 of file grid_worker.cpp.
◆ CGridWorkerNode() [3/4] ◆ CGridWorkerNode() [4/4] ◆ ChangePreferredAffinities() void CNetScheduleExecutor::ChangePreferredAffinities ( const vector< string > * affs_to_add, const vector< string > * affs_to_delete ) ◆ Check() ◆ CheckAffinity() void SInputValidator::CheckAffinity ( const string & value ) staticprivate ◆ CheckCancel() void SInputValidator::CheckCancel ( const string & value ) staticprivate ◆ CheckCtgTime() ◆ CheckEntry() ◆ CheckGetResults() ◆ CheckIfBatchAlreadySubmitted() void CGridJobBatchSubmitter::CheckIfBatchAlreadySubmitted ( ) private ◆ CheckIfBatchSubmittedAndPrepareNextJob() void CGridJobBatchSubmitter::CheckIfBatchSubmittedAndPrepareNextJob ( ) private ◆ CheckIfJobDone()Definition at line 1420 of file cgi2rcgi.cpp.
References CHTMLPage::AddTagMap(), CGridCgiContext::DefinePersistentEntry(), CCgi2RCgiApp::DefineRefreshTags(), done, CNetScheduleAPI::eCanceled, CNetScheduleAPI::eDone, CNetScheduleAPI::eFailed, CNetScheduleAPI::eJobNotFound, CNetScheduleAPI::ePending, CNetScheduleAPI::eRunning, CGridCgiContext::GetHTMLPage(), CGridCgiContext::GetJobKey(), CGridCgiContext::GetSelfURL(), kEmptyStr, kSinceTime, LOG_POST, CCgi2RCgiApp::m_CancelGoBackDelay, CCgi2RCgiApp::m_FallBackUrl, CCgi2RCgiApp::m_GridClient, CCgi2RCgiApp::m_Response, Note, CCgi2RCgiApp::OnJobDone(), CCgi2RCgiApp::OnJobFailed(), CGridCgiContext::SelectView(), CCgiResponse::SetHeaderValue(), CCgiApplication::SetRequestId(), and CNetScheduleAPI::StatusToString().
Referenced by CCgi2RCgiApp::CheckJob(), and CCgi2RCgiApp::SubmitJob().
◆ CheckJob()Definition at line 1054 of file cgi2rcgi.cpp.
References CCgi2RCgiApp::CheckIfJobDone(), CGridCgiContext::Clear(), CCgi2RCgiApp::DefineRefreshTags(), done, CNetScheduleAPI::eJobNotFound, CDiagContext::Extra(), CNetScheduleNotificationHandler::fJSM_Pending, CNetScheduleNotificationHandler::fJSM_Running, CCgiApplication::GetArgs(), GetDiagContext(), CGridCgiContext::GetJobKey(), CGridCgiContext::GetPersistentEntryValue(), CGridCgiContext::GetSelfURL(), CCgi2RCgiApp::GetStatus(), CCgi2RCgiApp::GetStatusAndCtgTime(), CGridCgiContext::HasCtgTime(), CCgi2RCgiApp::m_GridClient, CCgi2RCgiApp::m_NetScheduleAPI, CCgi2RCgiApp::m_RefreshDelay, CCgi2RCgiApp::m_RefreshWait, CDiagContext_Extra::Print(), and CNetScheduleNotificationHandler::WaitForJobEvent().
Referenced by CCgi2RCgiApp::ProcessRequest().
◆ CheckJobKey() void SInputValidator::CheckJobKey ( const string & value ) staticprivate ◆ Clear() void CGridCgiContext::Clear ( void ) private ◆ ClearNode() void CNetScheduleExecutor::ClearNode ( ) ◆ CloseStream() void CGridClient::CloseStream ( ) ◆ CloseStreams() void CWorkerNodeJobContext::CloseStreams ( ) ◆ CNetScheduleAPI() [1/7] ◆ CNetScheduleAPI() [2/7]Constructs a CNetScheduleAPI object and initializes it with parameters read from the specified configuration object.
Definition at line 753 of file netschedule_api.cpp.
◆ CNetScheduleAPI() [3/7]Constructs a CNetScheduleAPI object and initializes it with parameters read from the specified registry object.
Definition at line 747 of file netschedule_api.cpp.
◆ CNetScheduleAPI() [4/7]Construct the client without linking it to any particular server.
Actual server (host and port) will be extracted from the job key
Definition at line 758 of file netschedule_api.cpp.
◆ CNetScheduleAPI() [5/7]Creates an instance of CNetScheduleAPI and initializes it with parameters read from the application registry.
Definition at line 741 of file netschedule_api.cpp.
◆ CNetScheduleAPI() [6/7] ◆ CNetScheduleAPI() [7/7] ◆ CNetScheduleExecutor() [1/3] ◆ CNetScheduleExecutor() [2/3] ◆ CNetScheduleExecutor() [3/3] ◆ CNetScheduleJob() ◆ CNetScheduleJobReader() [1/3] ◆ CNetScheduleJobReader() [2/3] ◆ CNetScheduleJobReader() [3/3] ◆ CNetScheduleKey() [1/2] CNetScheduleKey::CNetScheduleKey ( ) inline ◆ CNetScheduleKey() [2/2] ◆ CNetScheduleKeyGenerator() CNetScheduleKeyGenerator::CNetScheduleKeyGenerator ( const string & host, unsigned port, const string & queue_name ) ◆ CNetScheduleNewJob() ◆ CNetScheduleSubmitter() [1/3] ◆ CNetScheduleSubmitter() [2/3] ◆ CNetScheduleSubmitter() [3/3] ◆ CollectParams() ◆ CommitJob() void CWorkerNodeJobContext::CommitJob ( ) ◆ CommitJobWithFailure() void CWorkerNodeJobContext::CommitJobWithFailure ( const string & err_msg, bool no_retries =false
) ◆ CreateContextWithFlags()
The same as CreateContext(), but allows for a custom set of flags to be specified in the CCgiRequest constructor.
Reimplemented from CCgiApplication.
Definition at line 717 of file cgi2rcgi.cpp.
References CCgiApplication::CreateContextWithFlags(), eCgi_ContentLength, env, eUseRequestContent, CCgiRequest::fDoNotParseContent, flags, CCgiRequest::fSaveRequestContent, CCgiRequest::GetPropertyName(), CCgi2RCgiApp::m_AffinitySource, NULL, out(), CNcbiApplicationAPI::SetEnvironment(), and NStr::StringToUInt().
◆ CreateInstance() [1/2]template<typename TWorkerNodeJob >
◆ CreateInstance() [2/2] virtual IWorkerNodeJob* IWorkerNodeJobFactory::CreateInstance ( void ) pure virtual ◆ CRegexpTemplateFilter() ◆ CRemoteCgiApp() CRemoteCgiApp::CRemoteCgiApp ( ) ◆ CWorkerNodeIdleTaskContext() [1/2] ◆ CWorkerNodeIdleTaskContext() [2/2] ◆ CWorkerNodeJobContext() [1/3] CWorkerNodeJobContext::CWorkerNodeJobContext ( ) inlineDefinition at line 197 of file grid_worker.hpp.
◆ CWorkerNodeJobContext() [2/3] ◆ CWorkerNodeJobContext() [3/3] ◆ DefinePersistentEntry() ◆ DefineRefreshTags()Definition at line 1305 of file cgi2rcgi.cpp.
References CGridCgiContext::AddTagMap(), CHTMLPlainText::eNoEncode, NStr::IntToString(), CHttpRetryContext::kHeader_Delay, CHttpRetryContext::kHeader_Url, CCgi2RCgiApp::m_HTMLPassThrough, CCgi2RCgiApp::m_Page, CCgi2RCgiApp::m_Response, CGridCgiContext::NeedMetaRefresh(), and CCgiResponse::SetHeaderValue().
Referenced by CCgi2RCgiApp::CheckIfJobDone(), CCgi2RCgiApp::CheckJob(), CCgi2RCgiApp::OnJobDone(), CCgi2RCgiApp::OnJobFailed(), and CCgi2RCgiApp::SubmitJob().
◆ DeletePreferredAffinities() void CNetScheduleExecutor::DeletePreferredAffinities ( const vector< string > & affs_to_del ) inline ◆ DisableDefaultRequestEventLogging() ◆ Do() ◆ ErrCodeToHTTPStatusCode() unsigned CNetScheduleException::ErrCodeToHTTPStatusCode ( ) constDefinition at line 120 of file netschedule_api_expt.cpp.
References CNetScheduleException::eAccessDenied, CNetScheduleException::eAffinityNotFound, CNetScheduleException::eAuthenticationError, CNetScheduleException::eClientDataVersionMismatch, CNetScheduleException::eDataTooLong, CNetScheduleException::eDuplicateName, CNetScheduleException::eGroupNotFound, CNetScheduleException::eInvalidAuthToken, CNetScheduleException::eInvalidClient, CNetScheduleException::eInvalidJobStatus, CNetScheduleException::eInvalidParameter, CNetScheduleException::eJobNotFound, CNetScheduleException::eKeyFormatError, CNetScheduleException::eObsoleteCommand, CNetScheduleException::ePrefAffExpired, CNetScheduleException::eProtocolSyntaxError, CNetScheduleException::eShuttingDown, CNetScheduleException::eSubmitsDisabled, CNetScheduleException::eTooManyPendingJobs, CNetScheduleException::eTooManyPreferredAffinities, CNetScheduleException::eTryAgain, CNetScheduleException::eUnknownQueue, CNetScheduleException::eUnknownQueueClass, CNetScheduleException::eUnknownService, and CException::GetErrCode().
Referenced by CNetScheduleHandler::OnMessage(), and CNetScheduleHandler::x_ProcessMsgQueue().
◆ ExtractWarningType() ◆ ForceSingleThread() void CGridWorkerNode::ForceSingleThread ( ) ◆ Generate() [1/2] void CNetScheduleKeyGenerator::Generate ( string * key, unsigned id ) const ◆ Generate() [2/2] string CNetScheduleKeyGenerator::Generate ( unsigned id ) const inline ◆ GenerateCompoundID() ◆ GetAdmin() ◆ GetAppName() [1/3] virtual string IWorkerNodeJobFactory::GetAppName ( void ) const inlinevirtual ◆ GetAppName() [2/3]template<typename TWorkerNodeJob >
◆ GetAppName() [3/3] string CGridWorkerNode::GetAppName ( void ) const ◆ GetAppVersion() [1/2] virtual string IWorkerNodeJobFactory::GetAppVersion ( void ) const inlinevirtual ◆ GetAppVersion() [2/2] ◆ GetArgs() virtual const CArgs& IWorkerNodeInitBaseContext::GetArgs ( ) const pure virtual ◆ GetBatch() ◆ GetBlobSize() size_t CGridClient::GetBlobSize ( ) const inline ◆ GetCGIContext() ◆ GetCheckStatusPeriod() unsigned CGridWorkerNode::GetCheckStatusPeriod ( ) const ◆ GetCleanupEventSource() [1/3] ◆ GetCleanupEventSource() [2/3] ◆ GetCleanupEventSource() [3/3] ◆ GetClientName() [1/3] ◆ GetClientName() [2/3] const string & CWorkerNodeJobContext::GetClientName ( ) const ◆ GetClientName() [3/3] const string & CGridWorkerNode::GetClientName ( ) const ◆ GetCode() ◆ GetCommitJobInterval() unsigned CGridWorkerNode::GetCommitJobInterval ( ) const ◆ GetCommitStatus() ◆ GetCommitStatusDescription() ◆ GetConfig() virtual const IRegistry& IWorkerNodeInitBaseContext::GetConfig ( ) const pure virtual ◆ GetDeadline() ◆ GetEntryValue() ◆ GetEnvironment() ◆ GetErrCodeDescription()Definition at line 151 of file netschedule_api_expt.cpp.
References CNetScheduleException::eAccessDenied, CNetScheduleException::eAffinityNotFound, CNetScheduleException::eAuthenticationError, CNetScheduleException::eClientDataVersionMismatch, CNetScheduleException::eDataTooLong, CNetScheduleException::eDuplicateName, CNetScheduleException::eGroupNotFound, CNetScheduleException::eInternalError, CNetScheduleException::eInvalidAuthToken, CNetScheduleException::eInvalidClient, CNetScheduleException::eInvalidJobStatus, CNetScheduleException::eInvalidParameter, CNetScheduleException::eJobNotFound, CNetScheduleException::eObsoleteCommand, CNetScheduleException::ePrefAffExpired, CNetScheduleException::eProtocolSyntaxError, CNetScheduleException::eShuttingDown, CNetScheduleException::eSubmitsDisabled, CNetScheduleException::eTooManyPreferredAffinities, CNetScheduleException::eTryAgain, CNetScheduleException::eUnknownQueue, CNetScheduleException::eUnknownQueueClass, CNetScheduleException::eUnknownService, and CNetScheduleException::GetErrCodeString().
Referenced by CNetScheduleServerListener::OnErrorImpl().
◆ GetErrCodeString() [1/4] const char * CNetScheduleException::GetErrCodeString ( void ) const overridevirtual ◆ GetErrCodeString() [2/4]Definition at line 85 of file netschedule_api_expt.cpp.
References CNetScheduleException::eAccessDenied, CNetScheduleException::eAffinityNotFound, CNetScheduleException::eAuthenticationError, CNetScheduleException::eClientDataVersionMismatch, CNetScheduleException::eDataTooLong, CNetScheduleException::eDuplicateName, CNetScheduleException::eGroupNotFound, CNetScheduleException::eInternalError, CNetScheduleException::eInvalidAuthToken, CNetScheduleException::eInvalidClient, CNetScheduleException::eInvalidJobStatus, CNetScheduleException::eInvalidParameter, CNetScheduleException::eJobNotFound, CNetScheduleException::eKeyFormatError, CNetScheduleException::eObsoleteCommand, CNetScheduleException::ePrefAffExpired, CNetScheduleException::eProtocolSyntaxError, CNetScheduleException::eShuttingDown, CNetScheduleException::eSubmitsDisabled, CNetScheduleException::eTooManyPendingJobs, CNetScheduleException::eTooManyPreferredAffinities, CNetScheduleException::eTryAgain, CNetScheduleException::eUnknownQueue, CNetScheduleException::eUnknownQueueClass, and CNetScheduleException::eUnknownService.
◆ GetErrCodeString() [3/4] virtual const char* CGridClientException::GetErrCodeString ( void ) const inlineoverridevirtual ◆ GetErrCodeString() [4/4] virtual const char* CGridWorkerNodeException::GetErrCodeString ( void ) const inlineoverridevirtual ◆ GetErrorMessage() ◆ GetExecutor() ◆ GetGridClient() [1/2] ◆ GetGridClient() [2/2] CGridClient& CGridCgiApplication::GetGridClient ( void ) inlineprotected ◆ GetHiddenFields() string CGridCgiContext::GetHiddenFields ( ) const ◆ GetHTMLPage() CHTMLPage& CGridCgiContext::GetHTMLPage ( void ) inline ◆ GetIdleTask() [1/2] ◆ GetIdleTask() [2/2]template<typename TWorkerNodeJob , typename TWorkerNodeIdleTask >
◆ GetInputBlobSize() size_t CWorkerNodeJobContext::GetInputBlobSize ( ) const ◆ GetIStream() [1/2] ◆ GetIStream() [2/2] ◆ GetJob() [1/5] ◆ GetJob() [2/5] ◆ GetJob() [3/5] ◆ GetJob() [4/5]Get a pending job.
When function returns TRUE, job information is written to the 'job' structure, and job status is changed to eRunning. This client (the worker node) becomes responsible for execution or returning of the job. If there are no jobs in the queue, the function returns FALSE immediately and this call has to be repeated.
Definition at line 282 of file netschedule_api_executor.cpp.
References CNetScheduleNewJob::affinity, cmd, CNetServer::ExecWithRetry(), g_AppendClientIPSessionIDHitID(), CNetScheduleNotificationHandler::MkBaseGETCmd(), NULL, CNetServer::SExecResult::response, s_ParseGetJobResponse(), and CNetScheduleJob::server.
Referenced by CGridCommandLineInterfaceApp::Cmd_RequestJob(), CGridCommandLineInterfaceApp::NetScheduleSanityCheck(), and CSampleNetScheduleNode::Run().
◆ GetJob() [5/5] ◆ GetJobBatchSubmitter() ◆ GetJobDetails() [1/2]Get job details.
Definition at line 929 of file netschedule_api.cpp.
References CNetScheduleNewJob::affinity, cmd, CNetScheduleAPI::eCanceled, CNetScheduleAPI::eConfirmed, CNetScheduleAPI::eDone, CNetScheduleAPI::eEmptyMask, CNetScheduleAPI::eFailed, CNetScheduleAPI::ePending, CNetScheduleAPI::eReadFailed, CNetScheduleAPI::eReading, CNetScheduleJob::error_msg, CNetScheduleAPI::eRunning, NStr::fConvErr_NoThrow, g_AppendClientIPSessionIDHitID(), CNetScheduleNewJob::input, CNetScheduleNewJob::job_id, CNetScheduleAPI::m_Impl, CNetScheduleNewJob::mask, CNetScheduleJob::output, CNetScheduleJob::progress_msg, CNetScheduleJob::ret_code, s_SetJobExpTime(), s_SetPauseMode(), NStr::StringToInt(), and CNetScheduleAPI::StringToStatus().
Referenced by CGridRPCBaseClient< CAsnBinCompressed >::Ask(), CGridRPCBaseClient< CAsnBinCompressed >::AskStream(), CGridCommandLineInterfaceApp::Cmd_GetJobInput(), CGridCommandLineInterfaceApp::Cmd_GetJobOutput(), CGridCommandLineInterfaceApp::Cmd_Replay(), g_ProcessJobInfo(), CNetScheduleNotificationHandler::GetJobDetailsIfCompleted(), CCgi2RCgiApp::ListenJobs(), CNetScheduleNotificationHandler::WaitForJobCompletion(), and CGridRPCBaseClient< CAsnBinCompressed >::x_GetJobById().
◆ GetJobDetails() [2/2] ◆ GetJobFactory() ◆ GetJobInput() [1/3] ◆ GetJobInput() [2/3] const string & CWorkerNodeJobContext::GetJobInput ( ) constGet a job input string.
This string can be used in two ways. 1. It can be an input data for a job (if that data is short) If it is so don't use GetIStream method. 2. It holds a key to a data stored in an external data storage. (NetCache) In this case use GetIStream method to get a stream with an input data for the job
Definition at line 63 of file wn_main_loop.cpp.
References CWorkerNodeJobContext::m_Impl.
◆ GetJobInput() [3/3] ◆ GetJobKey() [1/3] string& CGridCgiContext::GetJobKey ( void ) inline ◆ GetJobKey() [2/3] const string & CWorkerNodeJobContext::GetJobKey ( void ) const ◆ GetJobKey() [3/3] const string & CGridCgiContext::GetJobKey ( void ) const ◆ GetJobMask() ◆ GetJobNumber() unsigned int CWorkerNodeJobContext::GetJobNumber ( ) const ◆ GetJobOutput() [1/3] ◆ GetJobOutput() [2/3] const string & CWorkerNodeJobContext::GetJobOutput ( ) const ◆ GetJobOutput() [3/3] ◆ GetJobProgressMessage() const string& CGridCgiContext::GetJobProgressMessage ( void ) const inline ◆ GetJobReader() ◆ GetJobStatus() [1/2] ◆ GetJobStatus() [2/2] ◆ GetJobVersion() [1/3]template<typename TWorkerNodeJob >
◆ GetJobVersion() [2/3] string CRemoteCgiApp::GetJobVersion ( ) const virtual ◆ GetJobVersion() [3/3] virtual string IWorkerNodeJobFactory::GetJobVersion ( ) const pure virtual ◆ GetJqueryCallback() string& CGridCgiContext::GetJqueryCallback ( ) inline ◆ GetListenJobs() ◆ GetMaxServerInputSize() size_t CGridClient::GetMaxServerInputSize ( ) ◆ GetMaxThreads() unsigned CGridWorkerNode::GetMaxThreads ( ) const ◆ GetNetCacheAPI() [1/3] ◆ GetNetCacheAPI() [2/3] ◆ GetNetCacheAPI() [3/3] virtual CNetCacheAPI IWorkerNodeInitContext::GetNetCacheAPI ( ) const pure virtualGet the shared NetCacheAPI object used by the worker node framework.
Implemented in SGridWorkerNodeImpl.
◆ GetNetScheduleAPI() [1/2] ◆ GetNetScheduleAPI() [2/2] virtual CNetScheduleAPI IWorkerNodeInitContext::GetNetScheduleAPI ( ) const pure virtual ◆ GetNetScheduleSubmitter() ◆ GetNSExecutor() ◆ GetOStream() [1/3] ◆ GetOStream() [2/3] ◆ GetOStream() [3/3] ◆ GetPageTemplate() virtual string CGridCgiApplication::GetPageTemplate ( void ) const protectedpure virtual ◆ GetPageTitle() virtual string CGridCgiApplication::GetPageTitle ( void ) const protectedpure virtual ◆ GetPersistentEntries() ◆ GetPersistentEntryValue() ◆ GetProgramVersion() [1/3] const string & CNetScheduleAPI::GetProgramVersion ( void ) const ◆ GetProgramVersion() [2/3] virtual string CGridClientApp::GetProgramVersion ( void ) const pure virtual ◆ GetProgramVersion() [3/3] virtual string CGridCgiApplication::GetProgramVersion ( void ) const pure virtual ◆ GetProgressMessage() string CGridClient::GetProgressMessage ( )Get a job interim message.
Definition at line 259 of file grid_client.cpp.
References buffer, CNetCacheAPI::GetCompoundIDPool(), CGridClient::GetNetCacheAPI(), CGridClient::GetNetScheduleSubmitter(), CNetScheduleSubmitter::GetProgressMsg(), CNetCacheKey::IsValidKey(), CGridClient::m_Job, CGridClient::m_NetCacheAPI, CGridClient::m_UseProgress, CNetScheduleJob::progress_msg, CNetCacheAPI::ReadData(), and string.
Referenced by CGridCgiApplication::x_CheckJobStatus().
◆ GetProgressMsg() [1/3] ◆ GetProgressMsg() [2/3] ◆ GetProgressMsg() [3/3] ◆ GetQueryStringEntryValue() void CGridCgiContext::GetQueryStringEntryValue ( const string & entry_name, string & value ) const ◆ GetQueueName() [1/4] ◆ GetQueueName() [2/4] const string & CWorkerNodeJobContext::GetQueueName ( ) const ◆ GetQueueName() [3/4] ◆ GetQueueName() [4/4] ◆ GetQueueParams() [1/2] ◆ GetQueueParams() [2/2] ◆ GetQueueTimeout() unsigned CGridWorkerNode::GetQueueTimeout ( ) const ◆ GetRequestEntryValue() void CGridCgiContext::GetRequestEntryValue ( const string & entry_name, string & value ) const ◆ GetReturnCode() int CGridClient::GetReturnCode ( ) ◆ GetSelfURL() [1/2] string CGridCgiContext::GetSelfURL ( bool include_entries =true
) const ◆ GetSelfURL() [2/2] string CGridCgiContext::GetSelfURL ( void ) const
Get Self URL.
Definition at line 75 of file grid_cgiapp.cpp.
References map_checker< Container >::begin(), map_checker< Container >::end(), first(), CCgiContext::GetSelfURL(), CGridCgiContext::m_CgiContext, CGridCgiContext::m_PersistedEntries, NStr::URLEncode(), and rapidjson::value.
Referenced by CCgi2RCgiApp::CheckIfJobDone(), CCgi2RCgiApp::CheckJob(), CCgi2RCgiApp::PopulatePage(), CGridCgiApplication::ProcessRequest(), and CCgi2RCgiApp::SubmitJob().
◆ GetServerOutputSize() size_t CGridWorkerNode::GetServerOutputSize ( ) ◆ GetServerParams() [1/2] ◆ GetServerParams() [2/2] ◆ GetService()Definition at line 908 of file netschedule_api.cpp.
References CNetScheduleAPI::m_Impl.
Referenced by SNetScheduleJobReaderImpl::CImpl::CheckEntry(), CGridCommandLineInterfaceApp::Cmd_Exec(), CGridCommandLineInterfaceApp::Cmd_QueueInfo(), CGridCommandLineInterfaceApp::Cmd_Resume(), CGridCommandLineInterfaceApp::Cmd_ServerInfo(), CGridCommandLineInterfaceApp::Cmd_Stats(), CGridCommandLineInterfaceApp::Cmd_Suspend(), NAutomation::SNetScheduleServer::Create(), NAutomation::SNetScheduleService::ExecGetServers(), g_GetWorkerNodeInfo(), g_QueueClassInfoToJson(), g_QueueInfoToJson(), g_ReconfAndReturnJson(), g_ResumeNetSchedule(), g_SuspendNetSchedule(), NAutomation::SNetScheduleService::GetService(), NAutomation::SWorkerNode::GetService(), CCgi2RCgiApp::GetStatus(), CGridCommandLineInterfaceApp::PrintNetScheduleStats(), CGridCommandLineInterfaceApp::PrintNetScheduleStats_Generic(), CGetStatisticsProcessor::Process(), CNetScheduleAPI::SetCommunicationTimeout(), and CGridCommandLineInterfaceApp::SetUp_NetScheduleCmd().
◆ GetServiceName() [1/2] ◆ GetServiceName() [2/2] const string & CGridWorkerNode::GetServiceName ( ) const ◆ GetShutdownLevel()Check if job processing must be aborted.
This method must be called periodically from within the Do() method to check whether it needs to stop processing the current job. If GetShutdownLevel() returns eShutdownImmediate or eDie, the Do() method must immediately return its job to the server by calling context.ReturnJob() and return a non-zero integer to the caller.
If GetShutdownLevel() returns eNormalShutdown, the Do() method is free to decide whether the job processing must be aborted or completed.
Aside from the natural reason for GetShutdownLevel() to return eNormalShutdown, eShutdownImmediate, or eDie, (that is, when a worker node shutdown has been requested), this method can also return eShutdownImmediate when the NetSchedule server is not expecting the current job to complete. This can happen due to multiple reasons: 1. The job has been explicitly cancelled by the submitter or administrator. 2. The job was rescheduled to another worker node and has been successfully finished. 3. The job has expired.
Definition at line 282 of file wn_main_loop.cpp.
References CWorkerNodeJobContext::m_Impl.
Referenced by CJobContextProcessWatcher::OnStart(), CJobContextProcessWatcher::Watch(), and SWorkerNodeJobContextImpl::x_RunJob().
◆ GetStartupTime() time_t CGridWorkerNode::GetStartupTime ( ) const ◆ GetStatus() [1/2] ◆ GetStatus() [2/2]Definition at line 1336 of file cgi2rcgi.cpp.
References CHTMLPage::AddTagMap(), CNetScheduleAPI::eJobNotFound, ERR_POST, CNetScheduleAPI::eRunning, CNetService::ExcludeServer(), CNetScheduleAPI::GetAdmin(), CNetScheduleAPIExt::GetCompoundIDPool(), GetFastLocalTime(), CGridCgiContext::GetHTMLPage(), CGridCgiContext::GetJobKey(), CException::GetMsg(), CGridCgiContext::GetPersistentEntryValue(), CNetScheduleAdmin::GetQueueInfo(), CNetServiceIterator::GetServer(), CNetService::GetServer(), CNetScheduleAPI::GetService(), ncbi::grid::netcache::search::fields::key, kSinceTime, CCgi2RCgiApp::m_GridClient, CCgi2RCgiApp::m_NetScheduleAPI, CCgi2RCgiApp::m_TargetEncodeMode, NStr::StringToUInt(), and NStr::StringToUInt8().
Referenced by CCgi2RCgiApp::CheckJob().
◆ GetStatusAndCtgTime() ◆ GetSubmitter()Create an instance of CNetScheduleSubmitter.
Definition at line 886 of file netschedule_api.cpp.
References CNetScheduleAPI::m_Impl.
Referenced by CGridRPCBaseClient< CAsnBinCompressed >::Ask(), CGridRPCBaseClient< CAsnBinCompressed >::AskStream(), CGI2GRID_ComposeHtmlPage(), CGridCommandLineInterfaceApp::Cmd_CancelJob(), CGridCommandLineInterfaceApp::Cmd_JobInfo(), CCgi2RCgiApp::Init(), CGridClientApp::Init(), CGridCgiApplication::InitGridClient(), CSampleNetScheduleClient::Run(), CGridCommandLineInterfaceApp::SetUp_NetScheduleCmd(), and CGridRPCBaseClient< CAsnBinCompressed >::x_GetJobById().
◆ GetTotalMemoryLimit() Uint8 CGridWorkerNode::GetTotalMemoryLimit ( ) const ◆ GetTotalTimeLimit() unsigned CGridWorkerNode::GetTotalTimeLimit ( ) const ◆ GetWorkerNode() ◆ HandleEvent() ◆ HasCtgTime() bool CGridCgiContext::HasCtgTime ( ) const inline ◆ Init() [1/8] void CGridWorkerNode::Init ( void ) ◆ Init() [2/8] void CCgi2RCgiApp::Init ( void ) virtualThis method is called on the CGI application initialization – before starting to process a HTTP request or even receiving one.
No HTTP request (or context) is available at the time of call.
If you decide to override it, remember to call CCgiApplication::Init().
Reimplemented from CCgiApplicationCached.
Definition at line 549 of file cgi2rcgi.cpp.
References SInputValidator::AddAffinityEntry(), CGridClient::eAutomaticCleanup, CHTMLPlainText::eHTMLEncode, CHTMLPlainText::eJSONEncode, CGridClient::eManualCleanup, CHTMLPlainText::eNoEncode, CGridClient::eProgressMsgOff, CGridClient::eProgressMsgOn, IRegistry::eReturn, CArgDescriptions::eString, eUseQueryString, eUseRequestContent, CCgiRequest::fCaseInsensitiveArgs, CCgiRequest::fDoNotParseContent, flags, NStr::fSplit_MergeDelimiters, NStr::fSplit_Truncate, CNcbiApplicationAPI::GetArguments(), CNcbiApplicationAPI::GetRWConfig(), CNetScheduleAPI::GetSubmitter(), incs, CCgiApplicationCached::Init(), kEmptyStr, CCgi2RCgiApp::m_AddJobIdToHeader, CCgi2RCgiApp::m_AffinityName, CCgi2RCgiApp::m_AffinitySetLimit, CCgi2RCgiApp::m_AffinitySource, CCgi2RCgiApp::m_CancelGoBackDelay, CCgi2RCgiApp::m_ContentType, CCgi2RCgiApp::m_DateFormat, CCgi2RCgiApp::m_DisplayDonePage, CCgi2RCgiApp::m_ElapsedTimeFormat, CCgi2RCgiApp::m_ExceptionMessage, CCgi2RCgiApp::m_FallBackDelay, CCgi2RCgiApp::m_FallBackUrl, CCgi2RCgiApp::m_FirstDelay, CCgi2RCgiApp::m_GridClient, CCgi2RCgiApp::m_HtmlIncs, CCgi2RCgiApp::m_HTMLPassThrough, CCgi2RCgiApp::m_HtmlTemplate, CCgi2RCgiApp::m_InputValidator, CCgi2RCgiApp::m_InterceptJQueryCallback, CCgi2RCgiApp::m_NetCacheAPI, CCgi2RCgiApp::m_NetScheduleAPI, CCgi2RCgiApp::m_PortAdded, CCgi2RCgiApp::m_RefreshDelay, CCgi2RCgiApp::m_RefreshWait, CCgi2RCgiApp::m_TargetEncodeMode, CCgi2RCgiApp::m_Title, NCBI_THROW_FMT, CCgiApplication::RegisterDiagFactory(), CCgiApplication::SetRequestFlags(), CCgiApplication::SetupArgDescriptions(), and NStr::Split().
◆ Init() [3/8] ◆ Init() [4/8]template<typename TWorkerNodeJob >
◆ Init() [5/8]template<typename TWorkerNodeJob , typename TWorkerNodeIdleTask >
◆ Init() [6/8] void CGridClientApp::Init ( void ) virtualIf you override this method, do call CGridClientApp::Init() from inside your overriding method.
Reimplemented from CNcbiApplicationAPI.
Reimplemented in CRemoteAppClientSampleApp, and CGridClientSampleApp.
Definition at line 42 of file grid_client_app.cpp.
References cleanup(), CGridClient::eAutomaticCleanup, CGridClient::eManualCleanup, CGridClient::eProgressMsgOff, CGridClient::eProgressMsgOn, CNcbiApplicationAPI::GetConfig(), CGridClientApp::GetProgramVersion(), CNetScheduleAPI::GetSubmitter(), CNcbiApplicationAPI::Init(), kEmptyStr, CGridClientApp::m_GridClient, CNetScheduleAPI::SetProgramVersion(), CGridClientApp::UseAutomaticCleanup(), and CGridClientApp::UseProgressMessage().
Referenced by CRemoteAppClientSampleApp::Init(), and CGridClientSampleApp::Run().
◆ Init() [7/8] void CGridCgiApplication::Init ( void ) virtual ◆ Init() [8/8] void CRemoteCgiApp::Init ( void ) virtual ◆ InitGridClient() void CGridCgiApplication::InitGridClient ( ) protectedInitialize grid client.
Definition at line 195 of file grid_cgiapp.cpp.
References CGridClient::eAutomaticCleanup, CGridClient::eManualCleanup, CGridClient::eProgressMsgOff, CGridClient::eProgressMsgOn, IRegistry::eReturn, IRegistry::GetBool(), CNcbiApplicationAPI::GetConfig(), IRegistry::GetInt(), CGridCgiApplication::GetProgramVersion(), CNetScheduleAPI::GetSubmitter(), kEmptyStr, CGridCgiApplication::m_FirstDelay, CGridCgiApplication::m_GridClient, CGridCgiApplication::m_NetCacheAPI, CGridCgiApplication::m_NSClient, CGridCgiApplication::m_RefreshDelay, and CNetScheduleAPI::SetProgramVersion().
Referenced by CGridCgiApplication::Init().
◆ InterruptReading() void CNetScheduleJobReader::InterruptReading ( ) ◆ IsCachingNeeded() ◆ IsHostInAdminHostsList() ◆ IsJobCommitted() bool CWorkerNodeJobContext::IsJobCommitted ( ) const ◆ IsJobLost() bool CWorkerNodeJobContext::IsJobLost ( ) const ◆ IsLogRequested() bool CWorkerNodeJobContext::IsLogRequested ( ) const ◆ IsShutdownRequested() bool CWorkerNodeIdleTaskContext::IsShutdownRequested ( ) const ◆ IsSuspended() bool CGridWorkerNode::IsSuspended ( ) const ◆ JobDelayExpiration() [1/2] ◆ JobDelayExpiration() [2/2] void CWorkerNodeJobContext::JobDelayExpiration ( unsigned runtime_inc )Increment job execution timeout.
When node picks up the job for execution it may periodically communicate to the server that job is still alive and prolong job execution timeout, so job server does not try to reschedule.
Definition at line 260 of file wn_main_loop.cpp.
References CWorkerNodeJobContext::m_Impl.
Referenced by CJobContextProcessWatcher::Watch().
◆ JobStopRequested() virtual bool CGridCgiApplication::JobStopRequested ( void ) const inlineprotectedvirtual ◆ ListenJobs()Definition at line 933 of file cgi2rcgi.cpp.
References CNetScheduleAPI::eJobNotFound, CNetScheduleException::eJobNotFound, ERR_POST, SInputValidator::GetDeadline(), CException::GetErrCode(), CNetScheduleAPI::GetJobDetails(), SInputValidator::GetListenJobs(), CCgi2RCgiApp::m_GridClient, CCgi2RCgiApp::m_NetScheduleAPI, CCgi2RCgiApp::m_Response, out(), CCgiResponse::out(), s_IsPendingOrRunning(), CNetScheduleAPI::StringToStatus(), and Warning().
Referenced by CCgi2RCgiApp::ProcessRequest().
◆ LoadQueryStringTags() ◆ main() ◆ NCBI_EXCEPTION_DEFAULT() [1/3] ◆ NCBI_EXCEPTION_DEFAULT() [2/3] ◆ NCBI_EXCEPTION_DEFAULT() [3/3] ◆ NeedMetaRefresh() bool CGridCgiContext::NeedMetaRefresh ( ) const inline ◆ NeedRenderPage() [1/2] bool CGridCgiContext::NeedRenderPage ( ) const inline ◆ NeedRenderPage() [2/2] void CGridCgiContext::NeedRenderPage ( bool value ) inline ◆ NeedRunAgain() bool CWorkerNodeIdleTaskContext::NeedRunAgain ( ) const inline ◆ Notify() ◆ OnBeginProcessRequest() virtual void CGridCgiApplication::OnBeginProcessRequest ( CGridCgiContext & ) inlineprotectedvirtual ◆ OnEndProcessRequest() virtual void CGridCgiApplication::OnEndProcessRequest ( CGridCgiContext & ) inlineprotectedvirtual ◆ OnJobCanceled() ◆ OnJobDone() [1/2] ◆ OnJobDone() [2/2] ◆ OnJobFailed() [1/2] ◆ OnJobFailed() [2/2]Definition at line 1583 of file cgi2rcgi.cpp.
References ctx, CCgi2RCgiApp::DefineRefreshTags(), kEmptyStr, kSinceTime, CCgi2RCgiApp::m_FallBackDelay, CCgi2RCgiApp::m_FallBackUrl, CCgi2RCgiApp::m_TargetEncodeMode, and msg().
Referenced by CCgi2RCgiApp::CheckIfJobDone(), CCgi2RCgiApp::ProcessRequest(), CCgi2RCgiApp::ReadJob(), and CCgi2RCgiApp::SubmitJob().
◆ OnJobPending() ◆ OnJobRunning() ◆ OnJobSubmitted() ◆ OnQueueIsBusy() ◆ operator const SGridWorkerNodeImpl *() ◆ operator const SNetScheduleAPIImpl *() ◆ operator const SNetScheduleExecutorImpl *() ◆ operator const SNetScheduleJobReaderImpl *() ◆ operator const SNetScheduleSubmitterImpl *() ◆ operator const SWorkerNodeJobContextImpl *() ◆ operator SGridWorkerNodeImpl *() ◆ operator SNetScheduleAPIImpl *() ◆ operator SNetScheduleExecutorImpl *() ◆ operator SNetScheduleJobReaderImpl *() ◆ operator SNetScheduleSubmitterImpl *() ◆ operator SWorkerNodeJobContextImpl *() ◆ operator()() ◆ operator--() [1/12] ◆ operator--() [2/12] ◆ operator--() [3/12] ◆ operator--() [4/12] ◆ operator--() [5/12] ◆ operator--() [6/12] ◆ operator--() [7/12] ◆ operator--() [8/12] ◆ operator--() [9/12] ◆ operator--() [10/12] ◆ operator--() [11/12] ◆ operator--() [12/12] ◆ operator->() [1/12] ◆ operator->() [2/12] ◆ operator->() [3/12] ◆ operator->() [4/12] ◆ operator->() [5/12] ◆ operator->() [6/12] ◆ operator->() [7/12] ◆ operator->() [8/12] ◆ operator->() [9/12] ◆ operator->() [10/12] ◆ operator->() [11/12] ◆ operator->() [12/12] ◆ operator<<() ◆ operator=() [1/10] ◆ operator=() [2/10] ◆ operator=() [3/10] ◆ operator=() [4/10] ◆ operator=() [5/10] ◆ operator=() [6/10] ◆ operator=() [7/10] ◆ operator=() [8/10] ◆ operator=() [9/10] ◆ operator=() [10/10] ◆ ParseJobKey()Definition at line 62 of file netschedule_key.cpp.
References eCIT_DatabaseName, eCIT_Host, eCIT_ID, eCIT_IPv4SockAddr, eCIT_Port, CCompoundIDPool::FromString(), CCompoundIDField::GetDatabaseName(), CCompoundID::GetFirst(), CCompoundIDField::GetHost(), CCompoundIDField::GetID(), CCompoundIDField::GetIPv4Address(), CCompoundIDField::GetPort(), isdigit(), NS_KEY_V1_PREFIX, NS_KEY_V1_PREFIX_LEN, CSocketAPI::ntoa(), NULL, and dtl::version.
Referenced by CGridCommandLineInterfaceApp::Cmd_WhatIs(), and g_WhatIs().
◆ PopulatePage()Definition at line 1175 of file cgi2rcgi.cpp.
References CGridCgiContext::AddTagMap(), CHTMLPage::AddTagMap(), CTimeSpan::AsString(), CTime::AsString(), map_checker< Container >::begin(), map_checker< Container >::end(), CHTMLPlainText::eNoEncode, ERR_POST, GetFastLocalTime(), CGridCgiContext::GetHTMLPage(), CGridCgiContext::GetJobKey(), CGridCgiContext::GetPersistentEntries(), CGridCgiContext::GetPersistentEntryValue(), CGridCgiContext::GetSelfURL(), NStr::HtmlEncode(), HTTP_NCBI_JSID, kSinceTime, CCgi2RCgiApp::m_AddJobIdToHeader, CCgi2RCgiApp::m_DateFormat, CCgi2RCgiApp::m_ElapsedTimeFormat, CCgi2RCgiApp::m_GridClient, CCgi2RCgiApp::m_HTMLPassThrough, CCgi2RCgiApp::m_Page, CCgi2RCgiApp::m_Response, CCgi2RCgiApp::m_TargetEncodeMode, CCgiResponse::SetHeaderValue(), CGridCgiContext::SetJobProgressMessage(), CTime::SetTimeT(), and NStr::StringToInt().
Referenced by CCgi2RCgiApp::ProcessRequest().
◆ PrepareJobData() virtual void CGridCgiApplication::PrepareJobData ( CGridClient & grid_client ) protectedpure virtual ◆ PrepareNextJob() void CGridJobBatchSubmitter::PrepareNextJob ( ) ◆ ProcessRequest() [1/2]Do not override this method yourself! – it includes all the GRIDCGI specific machinery.
If you override it, do call CGridCgiApplication::ProcessRequest() from inside your overriding method.
Implements CCgiApplication.
Definition at line 242 of file grid_cgiapp.cpp.
References CGridClient::CancelJob(), CGridCgiContext::Clear(), CGridCgiApplication::CollectParams(), ctx, CNCBINode::eHTML, ERR_POST_X, CNetScheduleException::eTooManyPendingJobs, CGridCgiContext::GetEntryValue(), CException::GetErrCode(), CGridCgiApplication::GetGridClient(), CGridCgiContext::GetHiddenFields(), CGridCgiApplication::GetPageTemplate(), CGridCgiApplication::GetPageTitle(), CNcbiApplicationAPI::GetRWConfig(), CGridCgiContext::GetSelfURL(), kGridCgiForm, CGridCgiApplication::m_FirstDelay, CGridCgiApplication::m_RefreshDelay, CGridCgiApplication::m_Response, CGridCgiContext::NeedRenderPage(), CGridCgiApplication::OnBeginProcessRequest(), CGridCgiApplication::OnEndProcessRequest(), CGridCgiApplication::OnJobFailed(), CGridCgiApplication::OnJobSubmitted(), CGridCgiApplication::OnQueueIsBusy(), CCgiResponse::out(), CGridCgiApplication::PrepareJobData(), CGridCgiContext::PullUpPersistentEntry(), CGridCgiApplication::RenderRefresh(), CGridCgiContext::SetJobKey(), CGridCgiApplication::ShowParamsPage(), SleepMilliSec(), CGridClient::Submit(), CException::what(), CCgiResponse::WriteHeader(), CGridCgiApplication::x_CheckJobStatus(), and CGridCgiApplication::x_JobStopRequested().
◆ ProcessRequest() [2/2]This is the method you should override.
It is called whenever the CGI application gets a syntaxically valid HTTP request.
Implements CCgiApplication.
Definition at line 807 of file cgi2rcgi.cpp.
References CNetScheduleAPIExt::AddToClientNode(), CCgi2RCgiApp::CheckJob(), ctx, eCgi_QueryString, eCgi_ServerPort, CHTMLPlainText::eHTMLEncode, entries, env, ERR_POST, CCgiRequest::GetEntries(), CGridCgiContext::GetJobKey(), CGridCgiContext::GetJqueryCallback(), CCgiRequest::GetPropertyName(), kGridCgiForm, kPlainTextView, kSinceTime, CCgi2RCgiApp::ListenJobs(), CGridCgiContext::LoadQueryStringTags(), CCgi2RCgiApp::m_ContentType, CCgi2RCgiApp::m_CustomHTTPHeader, CCgi2RCgiApp::m_ExceptionMessage, CCgi2RCgiApp::m_HTMLPassThrough, CCgi2RCgiApp::m_HtmlTemplate, CCgi2RCgiApp::m_InputValidator, CCgi2RCgiApp::m_InterceptJQueryCallback, CCgi2RCgiApp::m_NetScheduleAPI, CCgi2RCgiApp::m_Page, CCgi2RCgiApp::m_PortAdded, CCgi2RCgiApp::m_Response, CCgi2RCgiApp::m_TargetEncodeMode, CCgi2RCgiApp::m_Title, CGridCgiContext::NeedRenderPage(), CCgi2RCgiApp::OnJobFailed(), CCgi2RCgiApp::PopulatePage(), CGridCgiContext::PullUpPersistentEntry(), CCgi2RCgiApp::RenderPage(), CCgiResponse::RequireWriteHeader(), s_RemoveCallbackParameter(), CCgiResponse::SetContentType(), CNcbiApplicationAPI::SetEnvironment(), CCgi2RCgiApp::SubmitJob(), and CNetScheduleAPIExt::UpdateAuthString().
◆ PullUpPersistentEntry() [1/2] void CGridCgiContext::PullUpPersistentEntry ( const string & entry_name ) ◆ PullUpPersistentEntry() [2/2] ◆ PutFailure()Submit job failure diagnostics.
This method indicates that job failed because of some fatal, unrecoverable error.
Definition at line 493 of file netschedule_api_executor.cpp.
References CNetScheduleJob::auth_token, cmd, CNetScheduleJob::error_msg, g_AppendClientIPSessionIDHitID(), CNetScheduleNewJob::job_id, kNetScheduleMaxDBErrSize, NCBI_THROW, NStr::NumericToString(), CNetScheduleJob::output, NStr::PrintableString(), CNetScheduleJob::ret_code, and s_CheckOutputSize().
Referenced by CGridCommandLineInterfaceApp::Cmd_CommitJob(), CGridCommandLineInterfaceApp::NetScheduleSanityCheck(), CJobCommitterThread::x_CommitJob(), and CWNJobWatcher::x_KillNode().
◆ PutProgressMessage() [1/2] ◆ PutProgressMessage() [2/2] ◆ PutProgressMsg() ◆ PutResult()Put job result (job should be received by GetJob() or WaitJob())
Definition at line 452 of file netschedule_api_executor.cpp.
References CNetScheduleJob::auth_token, cmd, g_AppendClientIPSessionIDHitID(), CNetScheduleNewJob::job_id, NStr::NumericToString(), CNetScheduleJob::output, NStr::PrintableString(), CNetScheduleJob::ret_code, and s_CheckOutputSize().
Referenced by CGridCommandLineInterfaceApp::Cmd_CommitJob(), CGridCommandLineInterfaceApp::NetScheduleSanityCheck(), CSampleNetScheduleNode::Run(), and CJobCommitterThread::x_CommitJob().
◆ Read()Incremental retrieval of jobs that are done or failed.
Definition at line 298 of file netschedule_api_submitter.cpp.
References cmd, CNetService::eRandomize, g_AppendClientIPSessionIDHitID(), NULL, and NStr::UIntToString().
◆ ReadConfirm() ◆ ReadFail()Refuse from processing the results of the specified job and increase its counter of failed job result retrievals.
If this counter exceeds the failed_read_retries parameter specified in the configuration file, the job will permanently change its status to 'ReadFailed'.
Definition at line 356 of file netschedule_api_submitter.cpp.
Referenced by CGridCommandLineInterfaceApp::Cmd_ReadJob().
◆ ReadJob()Definition at line 1480 of file cgi2rcgi.cpp.
References ctx, NStr::eNocase, ERR_POST, NStr::eTrunc_End, HTTP_NCBI_JSID, CCgi2RCgiApp::m_AddJobIdToHeader, CCgi2RCgiApp::m_ExceptionMessage, CCgi2RCgiApp::m_Response, NcbiStreamCopy(), CCgi2RCgiApp::OnJobFailed(), out(), CCgiResponse::out(), CException::ReportAll(), NStr::StartsWith(), NStr::TruncateSpacesInPlace(), Warning(), and CException::what().
Referenced by CCgi2RCgiApp::OnJobDone().
◆ ReadNextJob() ◆ ReadRollback() ◆ RemoveDataBlob() void CGridClient::RemoveDataBlob ( const string & data_key ) private ◆ RemoveListener() ◆ RenderPage() int CCgi2RCgiApp::RenderPage ( ) privateDefinition at line 1227 of file cgi2rcgi.cpp.
References CNCBINode::eHTML, NStr::eNocase, CNCBINode::ePlainText, ERR_POST, NStr::fSplit_MergeDelimiters, NStr::fSplit_Truncate, isspace(), CCgi2RCgiApp::m_CustomHTTPHeader, CCgi2RCgiApp::m_HtmlIncs, CCgi2RCgiApp::m_Page, CCgi2RCgiApp::m_Response, CCgi2RCgiApp::m_Title, out(), CCgiResponse::out(), CCgiResponse::SetStatus(), NStr::SplitInTwo(), NStr::StartsWith(), NStr::StringToUInt(), NStr::TruncateSpaces(), NStr::TruncateSpacesInPlace(), Warning(), and CCgiResponse::WriteHeader().
Referenced by CCgi2RCgiApp::ProcessRequest().
◆ RenderRefresh() ◆ RequestExclusiveMode() void CWorkerNodeJobContext::RequestExclusiveMode ( )Instruct the system that this job requires all system's resources If this method is call, the node will not accept any other jobs until this one is done.
In the event if the mode has already been requested by another job this job will be returned back to the queue.
Definition at line 359 of file wn_main_loop.cpp.
References CWorkerNodeJobContext::m_Impl, and NCBI_THROW.
◆ RequestShutdown() [1/3] void CWorkerNodeIdleTaskContext::RequestShutdown ( void ) ◆ RequestShutdown() [2/3] void CGridWorkerNode::RequestShutdown ( void ) ◆ RequestShutdown() [3/3] void CRemoteCgiApp::RequestShutdown ( void ) ◆ Reschedule() ◆ RescheduleJob() ◆ Reset() [1/4] void CGridJobBatchSubmitter::Reset ( void ) ◆ Reset() [2/4] void CWorkerNodeIdleTaskContext::Reset ( void ) ◆ Reset() [3/4] void CNetScheduleNewJob::Reset ( void ) inline ◆ Reset() [4/4] void CNetScheduleJob::Reset ( void ) inlineDefinition at line 352 of file netschedule_api.hpp.
References CNetScheduleJob::auth_token, CNetScheduleJob::client_ip, CNetScheduleJob::error_msg, NULL, CNetScheduleJob::output, CNetScheduleJob::page_hit_id, CNetScheduleJob::progress_msg, CNetScheduleNewJob::Reset(), CNetScheduleJob::ret_code, CNetScheduleJob::server, and CNetScheduleJob::session_id.
Referenced by CJobCommitterThread::AllocJobContext(), CMostAffinityJob< TImpl >::Interrupt(), CGridClient::SetJobKey(), and CGridClient::Submit().
◆ Resume() void CGridWorkerNode::Resume ( ) ◆ ReturnJob() [1/2] void CWorkerNodeJobContext::ReturnJob ( ) ◆ ReturnJob() [2/2] ◆ Run() [1/3] ◆ Run() [2/3] ◆ Run() [3/3] int CRemoteCgiApp::Run ( void ) virtual ◆ RunJob()Definition at line 172 of file remote_cgiapp.cpp.
References CCgiApplication::ConfigureDiagnostics(), CCgiApplication::eEndRequest, CCgiApplication::eError, CCgiApplication::eException, CCgiApplication::eExit, CCgiApplication::eSuccess, CCgiRequest::fSetDiagProperties, CRemoteCgiApp::m_JobContext, CCgiApplication::m_RequestFlags, NULL, CCgiApplication::OnEvent(), CCgiApplication::OnException(), CCgiContext::ProcessCORSRequest(), and CCgiApplication::ProcessRequest().
Referenced by CCgiWorkerNodeJob::Do().
◆ s_GetCtgTime() ◆ s_IsPendingOrRunning() ◆ s_RemoveCallbackParameter() static void s_RemoveCallbackParameter ( string * query_string ) static ◆ SelectView() void CGridCgiContext::SelectView ( const string & view_name ) ◆ SEntry()template<class TF >
SInputValidator::SEntry::SEntry ( string n, TF f ) inlineDefinition at line 109 of file cgi2rcgi.cpp.
◆ SetAffinityPreference() ◆ SetClientNode() void CNetScheduleAPI::SetClientNode ( const string & client_node ) ◆ SetClientSession() void CNetScheduleAPI::SetClientSession ( const string & client_session ) ◆ SetClientType() ◆ SetCommunicationTimeout() void CNetScheduleAPI::SetCommunicationTimeout ( const STimeout & to ) inline ◆ SetCompleteResponse() void CGridCgiContext::SetCompleteResponse ( CNcbiIstream & is ) ◆ SetJobAffinity() [1/2] void CGridJobBatchSubmitter::SetJobAffinity ( const string & affinity ) ◆ SetJobAffinity() [2/2] void CGridClient::SetJobAffinity ( const string & affinity ) inline ◆ SetJobGroup() [1/2] ◆ SetJobGroup() [2/2] void CNetScheduleExecutor::SetJobGroup ( const string & job_group ) ◆ SetJobInput() [1/3] void CGridJobBatchSubmitter::SetJobInput ( const string & input ) ◆ SetJobInput() [2/3]Set a job's input This string will be sent to then the job is submitted.
This method can be used to send a short data to the worker node. To send a large data use GetOStream method. Don't call this method after GetOStream method is called.
Definition at line 88 of file grid_client.cpp.
References CNetScheduleNewJob::input, input(), and CGridClient::m_Job.
◆ SetJobInput() [3/3] void CGridCgiContext::SetJobInput ( const string & input ) inlineprivate ◆ SetJobKey() [1/2] ◆ SetJobKey() [2/2] void CGridCgiContext::SetJobKey ( const string & job_key ) private ◆ SetJobMask() [1/2] ◆ SetJobMask() [2/2] ◆ SetJobOutput() [1/2] void CWorkerNodeJobContext::SetJobOutput ( const string & output )Set a job's output.
This string will be sent to the queue when job is done.
This method can be used to send a short data back to the client. To send a large result use GetOStream method. Don't call this method after GetOStream method is called.
Definition at line 68 of file wn_main_loop.cpp.
References CWorkerNodeJobContext::m_Impl, and output.
◆ SetJobOutput() [2/2] void CGridCgiContext::SetJobOutput ( const string & output ) inlineprivate ◆ SetJobProgressMessage() void CGridCgiContext::SetJobProgressMessage ( const string & msg ) inlineprivate ◆ SetJobRetCode() void CWorkerNodeJobContext::SetJobRetCode ( int ret_code ) ◆ SetListener() ◆ SetProgramVersion() void CNetScheduleAPI::SetProgramVersion ( const string & pv ) ◆ SetRunAgain() void CWorkerNodeIdleTaskContext::SetRunAgain ( ) inline ◆ SetupArgDescriptions() ◆ SExceptionMessage() ◆ ShowParamsPage() virtual void CGridCgiApplication::ShowParamsPage ( CGridCgiContext & ctx ) const protectedpure virtual ◆ SInputValidator() SInputValidator::SInputValidator ( ) ◆ SJob() ◆ StatusToString()Printable status type.
Definition at line 781 of file netschedule_api.cpp.
References _ASSERT, CNetScheduleAPI::eCanceled, CNetScheduleAPI::eConfirmed, CNetScheduleAPI::eDeleted, CNetScheduleAPI::eDone, CNetScheduleAPI::eFailed, CNetScheduleAPI::eJobNotFound, CNetScheduleAPI::ePending, CNetScheduleAPI::eReadFailed, CNetScheduleAPI::eReading, CNetScheduleAPI::eRunning, and kEmptyStr.
Referenced by CGridRPCBaseClient< CAsnBinCompressed >::Ask(), CGridRPCBaseClient< CAsnBinCompressed >::AskStream(), CNSNotificationList::BuildJobChangedNotification(), CCgi2RCgiApp::CheckIfJobDone(), CGridCommandLineInterfaceApp::Cmd_GetJobOutput(), CGridCommandLineInterfaceApp::Cmd_ReadJob(), CGridCommandLineInterfaceApp::Cmd_Replay(), CGridCommandLineInterfaceApp::Cmd_SubmitJob(), CGridCommandLineInterfaceApp::Cmd_WatchJob(), CStatisticsCounters::CStatisticsCounters(), CNetScheduleAdmin::DumpQueue(), g_DoPerfLogging(), g_ProcessJobInfo(), SWorkerNodeJobContextImpl::GetShutdownLevel(), CGridCommandLineInterfaceApp::JobInfo_PrintStatus(), operator<<(), CNSClient::Print(), CQueue::PrintJobsStat(), CGridCommandLineInterfaceApp::PrintJobStatusNotification(), s_FormResourceName(), CNetScheduleJobSerializer::SaveJobOutput(), CJob::x_AppendEvents(), CJob::x_AppendStatus(), CQueue::x_ChangeReadingStatus(), CGridCgiApplication::x_CheckJobStatus(), CNetScheduleHandler::x_FinalizeReadCommand(), CGridRPCBaseClient< CAsnBinCompressed >::x_GetJobById(), CNSGroupsRegistry::x_PrintOne(), CNSScopeRegistry::x_PrintOne(), CNSAffinityRegistry::x_PrintOne(), CNetScheduleHandler::x_ProcessFastStatusS(), CNetScheduleHandler::x_ProcessFastStatusW(), CNetScheduleHandler::x_ProcessJobDelayExpiration(), CNetScheduleHandler::x_ProcessJobDelayReadExpiration(), CNetScheduleHandler::x_ProcessListenJob(), CNetScheduleHandler::x_ProcessPut(), CNetScheduleHandler::x_ProcessPutFailure(), CNetScheduleHandler::x_ProcessQueueInfo(), CNetScheduleHandler::x_ProcessReading(), CNetScheduleHandler::x_ProcessRedo(), CNetScheduleHandler::x_ProcessReread(), CNetScheduleHandler::x_ProcessReschedule(), CNetScheduleHandler::x_ProcessReturn(), CNetScheduleHandler::x_ProcessStatistics(), CNetScheduleHandler::x_ProcessStatus(), and CNetScheduleHandler::x_RemoveDuplicateStatuses().
◆ StringToStatus()Parse status string into enumerator value.
Acceptable string values: Pending, Running, Canceled, Failed, Done, Reading, Confirmed, ReadFailed, Abbreviated Pend, Run, Return, Cancel, Fail
Definition at line 801 of file netschedule_api.cpp.
References NStr::CompareNocase(), CNetScheduleAPI::eCanceled, CNetScheduleAPI::eConfirmed, CNetScheduleAPI::eDeleted, CNetScheduleAPI::eDone, CNetScheduleAPI::eFailed, CNetScheduleAPI::eJobNotFound, CNetScheduleAPI::ePending, CNetScheduleAPI::eReadFailed, CNetScheduleAPI::eReading, and CNetScheduleAPI::eRunning.
Referenced by SNSCommandArguments::AssignValues(), CNetScheduleNotificationHandler::CheckJobStatusNotification(), CReadCmdExecutor::Consider(), g_LegacyStatToJson(), CNetScheduleAPI::GetJobDetails(), CNetScheduleNotificationHandler::GetJobDetailsIfCompleted(), SNetScheduleAPIImpl::GetJobStatus(), CCgi2RCgiApp::GetStatusAndCtgTime(), CCgi2RCgiApp::ListenJobs(), CNetScheduleNotificationHandler::RequestJobWatching(), s_ParseReadJobResponse(), and CGridCommandLineInterfaceApp::StringToJobStatus().
◆ Submit() [1/2]Submit a job to the queue.
Definition at line 103 of file grid_client.cpp.
References CNetScheduleNewJob::affinity, CGridClient::CloseStream(), CGridClient::GetNetScheduleSubmitter(), SNetScheduleSubmitterImpl::m_API, CGridClient::m_Job, SNetScheduleAPIImpl::m_JobTtl, CGridClient::m_NetScheduleSubmitter, CNetScheduleJob::Reset(), CNetScheduleSubmitter::SubmitJob(), and CGridClient::x_RenewAllJobBlobs().
Referenced by CGridCgiApplication::ProcessRequest(), CGridClientSampleApp::Run(), and CRemoteAppClientSampleApp::Run().
◆ Submit() [2/2] ◆ SubmitAndWait() ◆ SubmitJob() [1/2]Definition at line 1097 of file cgi2rcgi.cpp.
References CCgi2RCgiApp::CheckIfJobDone(), CGridCgiContext::Clear(), crc32, CGridCgiContext::DefinePersistentEntry(), CCgi2RCgiApp::DefineRefreshTags(), done, CChecksum::eCRC32, ERR_POST, CNetScheduleException::eTooManyPendingJobs, CDiagContext::Extra(), CCgiRequest::GetContent(), GetDiagContext(), CException::GetErrCode(), GetFastLocalTime(), CGridCgiContext::GetJobKey(), CGridCgiContext::GetSelfURL(), CNetScheduleNewJob::job_id, kEmptyStr, kSinceTime, CCgi2RCgiApp::m_AffinityName, CCgi2RCgiApp::m_AffinitySetLimit, CCgi2RCgiApp::m_AffinitySource, CCgi2RCgiApp::m_ExceptionMessage, CCgi2RCgiApp::m_FirstDelay, CCgi2RCgiApp::m_GridClient, CCgi2RCgiApp::m_RefreshDelay, NStr::NumericToString(), CCgi2RCgiApp::OnJobFailed(), CDiagContext_Extra::Print(), CGridCgiContext::PullUpPersistentEntry(), s_IsPendingOrRunning(), CGridCgiContext::SelectView(), CCgiRequest::Serialize(), NStr::UIntToString(), and CException::what().
Referenced by CCgi2RCgiApp::ProcessRequest().
◆ SubmitJob() [2/2] ◆ SubmitJobAndWait()Submit job to server and wait for the result.
This function should be used if we expect that job execution infrastructure is capable of finishing job in the specified time frame. This method can save a lot of round trips with the NetSchedule server (comparing to series of GetStatus calls).
Definition at line 404 of file netschedule_api_submitter.cpp.
◆ SubmitJobBatch()Submit job batch.
Method automatically splits the submission into reasonable sized transactions, so there is no limit on the input batch size.
Every job in the job list receives job id
Definition at line 132 of file netschedule_api_submitter.cpp.
References cmd, CNetServer::SExecResult::conn, CNetServerConnection::Exec(), CNetScheduleKeyGenerator::Generate(), i, ITERATE, NCBI_THROW, s_CheckInputSize(), s_SerializeJob(), NStr::UIntToString(), and SNetServerConnectionImpl::WriteLine().
Referenced by CGridJobBatchSubmitter::Submit().
◆ Suspend() void CGridWorkerNode::Suspend ( bool pullback, unsigned timeout ) ◆ TestAttribute() ◆ UseAutomaticCleanup() bool CGridClientApp::UseAutomaticCleanup ( ) const protectedvirtual ◆ UseProgressMessage() bool CGridClientApp::UseProgressMessage ( ) const protectedvirtual ◆ WaitForJob() [1/2] ◆ WaitForJob() [2/2] ◆ WarningTypeToString() ◆ x_CheckAllJobBlobs()Definition at line 218 of file grid_client.cpp.
References CNetScheduleAPI::eCanceled, CNetScheduleAPI::eDone, CGridClient::GetNetScheduleSubmitter(), CNetScheduleSubmitter::GetProgressMsg(), CNetScheduleNewJob::input, CGridClient::m_AutoCleanUp, CGridClient::m_Job, CGridClient::m_JobDetailsRead, CGridClient::m_UseProgress, CNetScheduleJob::progress_msg, CGridClient::RemoveDataBlob(), s_TimeToTtl(), and CGridClient::x_RenewAllJobBlobs().
Referenced by CGridClient::GetStatus(), CGridClient::SubmitAndWait(), and CGridClient::WaitForJob().
◆ x_CheckJobStatus()Definition at line 392 of file grid_cgiapp.cpp.
References _ASSERT, CNetScheduleAPI::eCanceled, CNetScheduleAPI::eDone, CNetScheduleAPI::eFailed, CNetScheduleAPI::eJobNotFound, CNetScheduleAPI::ePending, CNetScheduleAPI::eRunning, CGridCgiContext::GetCGIContext(), CGridCgiContext::GetEntryValue(), CGridClient::GetErrorMessage(), CGridCgiApplication::GetGridClient(), CGridClient::GetJobInput(), CGridClient::GetJobOutput(), CGridClient::GetProgressMessage(), CCgiContext::GetResponse(), CGridClient::GetStatus(), CGridCgiApplication::OnJobCanceled(), CGridCgiApplication::OnJobDone(), CGridCgiApplication::OnJobFailed(), CGridCgiApplication::OnJobPending(), CGridCgiApplication::OnJobRunning(), CGridCgiContext::SetJobInput(), CGridClient::SetJobKey(), CGridCgiContext::SetJobOutput(), CGridCgiContext::SetJobProgressMessage(), CCgiApplication::SetRequestId(), and CNetScheduleAPI::StatusToString().
Referenced by CGridCgiApplication::ProcessRequest().
◆ x_GetJobDetails() void CGridClient::x_GetJobDetails ( ) private ◆ x_JobStopRequested() ◆ x_ProlongBlobLifetime() void CGridClient::x_ProlongBlobLifetime ( const string & blob_key, unsigned ttl ) private ◆ x_ProlongJobFieldLifetime() bool CGridClient::x_ProlongJobFieldLifetime ( const string & job_field, unsigned ttl ) private ◆ x_RenewAllJobBlobs() void CGridClient::x_RenewAllJobBlobs ( unsigned ttl ) privateDefinition at line 326 of file grid_client.cpp.
References CNetCacheAPI::GetCompoundIDPool(), CNetScheduleNewJob::input, CGridClient::m_Job, CGridClient::m_NetCacheAPI, NULL, CNetScheduleJob::output, CNetCacheKey::ParseBlobKey(), CNetScheduleJob::progress_msg, CGridClient::x_ProlongBlobLifetime(), and CGridClient::x_ProlongJobFieldLifetime().
Referenced by CGridClient::Submit(), CGridClient::x_CheckAllJobBlobs(), and CGridClient::x_GetJobDetails().
◆ ~CGridCgiContext() ◆ ~IWorkerNodeCleanupEventListener() virtual IWorkerNodeCleanupEventListener::~IWorkerNodeCleanupEventListener ( ) inlinevirtualDefinition at line 90 of file grid_worker.hpp.
◆ ~IWorkerNodeIdleTask() virtual IWorkerNodeIdleTask::~IWorkerNodeIdleTask ( ) inlinevirtualDefinition at line 404 of file grid_worker.hpp.
◆ ~IWorkerNodeInitBaseContext() virtual IWorkerNodeInitBaseContext::~IWorkerNodeInitBaseContext ( ) inlinevirtualDefinition at line 117 of file grid_worker.hpp.
◆ ~IWorkerNodeJob() virtual IWorkerNodeJob::~IWorkerNodeJob ( ) inlinevirtualDefinition at line 162 of file grid_worker.hpp.
◆ ~IWorkerNodeJobFactory() virtual IWorkerNodeJobFactory::~IWorkerNodeJobFactory ( ) inlinevirtualDefinition at line 419 of file grid_worker.hpp.
◆ ~IWorkerNodeJobWatcher() IWorkerNodeJobWatcher::~IWorkerNodeJobWatcher ( ) virtualDefinition at line 55 of file grid_worker.cpp.
◆ affinity string CNetScheduleNewJob::affinityDefinition at line 328 of file netschedule_api.hpp.
Referenced by CCgiEnvHolder::CCgiEnvHolder(), CGridCommandLineInterfaceApp::Cmd_SubmitJob(), CMostAffinityJob< TImpl >::Done(), SNetScheduleExecutorImpl::ExecGET(), CAppEnvHolder::GetEnv(), CNetScheduleExecutor::GetJob(), CNetScheduleAPI::GetJobDetails(), CNetScheduleJobSerializer::LoadJobInput(), CGridCommandLineInterfaceApp::PrintJobAttrsAndDumpInput(), CNetScheduleExecutor::Reschedule(), CNetScheduleNewJob::Reset(), s_DoParseGet2JobResponse(), s_ParseReadJobResponse(), s_SerializeJob(), CNetScheduleJobSerializer::SaveJobInput(), CGridClient::SetJobAffinity(), and CGridClient::Submit().
◆ auth_token string CNetScheduleJob::auth_tokenDefinition at line 377 of file netschedule_api.hpp.
Referenced by SGridWorkerNodeImpl::SJobsInProgress::Add(), CGridCommandLineInterfaceApp::Cmd_CommitJob(), CGridCommandLineInterfaceApp::Cmd_ReadJob(), CGridCommandLineInterfaceApp::Cmd_ReturnJob(), CGridCommandLineInterfaceApp::PrintJobAttrsAndDumpInput(), CNetScheduleExecutor::PutFailure(), CNetScheduleExecutor::PutResult(), CNetScheduleExecutor::Reschedule(), CNetScheduleJob::Reset(), SNetScheduleJobReaderImpl::CImpl::ReturnJob(), SNetScheduleExecutorImpl::ReturnJob(), s_DoParseGet2JobResponse(), s_ParseReadJobResponse(), and SGridWorkerNodeImpl::SJobsInProgress::Update().
◆ client_ip string CNetScheduleJob::client_ip ◆ error_msg string CNetScheduleJob::error_msg ◆ group string CNetScheduleNewJob::group ◆ host ◆ id unsigned CNetScheduleKey::id ◆ input string CNetScheduleNewJob::inputInput data.
Arbitrary string that contains input data for the job. It is suggested to use NetCache to keep the actual data and pass NetCache key as job input.
Definition at line 326 of file netschedule_api.hpp.
Referenced by CGridCommandLineInterfaceApp::Cmd_GetJobInput(), CGridCommandLineInterfaceApp::Cmd_Replay(), CGridCommandLineInterfaceApp::Cmd_SubmitJob(), g_ProcessJobInfo(), SWorkerNodeJobContextImpl::GetIStream(), CNetScheduleAPI::GetJobDetails(), CGridClient::GetJobInput(), CGridClient::GetOStream(), CNetScheduleJobSerializer::LoadJobInput(), CGridCommandLineInterfaceApp::NetScheduleSanityCheck(), CGridCommandLineInterfaceApp::PrintJobAttrsAndDumpInput(), CNetScheduleNewJob::Reset(), CSampleNetScheduleNode::Run(), s_DoParseGet2JobResponse(), s_SerializeJob(), CNetScheduleJobSerializer::SaveJobInput(), CGridClient::SetJobInput(), SNetScheduleSubmitterImpl::SubmitJobImpl(), CGridClient::x_CheckAllJobBlobs(), and CGridClient::x_RenewAllJobBlobs().
◆ job_id string CNetScheduleNewJob::job_idOutput job key.
Definition at line 335 of file netschedule_api.hpp.
Referenced by SGridWorkerNodeImpl::SJobsInProgress::Add(), CCgiEnvHolder::CCgiEnvHolder(), SWorkerNodeJobContextImpl::CheckIfJobIsLost(), CGridCommandLineInterfaceApp::Cmd_CommitJob(), CGridCommandLineInterfaceApp::Cmd_GetJobInput(), CGridCommandLineInterfaceApp::Cmd_GetJobOutput(), CGridCommandLineInterfaceApp::Cmd_JobInfo(), CGridCommandLineInterfaceApp::Cmd_ReadJob(), CGridCommandLineInterfaceApp::Cmd_Replay(), CGridCommandLineInterfaceApp::Cmd_RequestJob(), CGridCommandLineInterfaceApp::Cmd_ReturnJob(), CGridCommandLineInterfaceApp::Cmd_SubmitJob(), CGridCommandLineInterfaceApp::Cmd_UpdateJob(), CMostAffinityJob< TImpl >::Done(), g_ProcessJobInfo(), CAppEnvHolder::GetEnv(), CNetScheduleAPI::GetJobDetails(), CNetScheduleNotificationHandler::GetJobDetailsIfCompleted(), CNetScheduleSubmitter::GetJobStatus(), SNetScheduleAPIImpl::GetJobStatus(), CNetScheduleAPI::GetProgressMsg(), SNetScheduleAPIImpl::GetServer(), SWorkerNodeJobContextImpl::GetShutdownLevel(), CNetScheduleExecutor::JobDelayExpiration(), CNetScheduleJobSerializer::LoadJobInput(), CGridCommandLineInterfaceApp::NetScheduleSanityCheck(), CGridCommandLineInterfaceApp::PrintJobAttrsAndDumpInput(), CNetScheduleExecutor::PutFailure(), SWorkerNodeJobContextImpl::PutProgressMessage(), CNetScheduleExecutor::PutProgressMsg(), CNetScheduleExecutor::PutResult(), SGridWorkerNodeImpl::SJobsInProgress::Remove(), CNetScheduleExecutor::Reschedule(), CNetScheduleNewJob::Reset(), SNetScheduleJobReaderImpl::CImpl::ReturnJob(), SNetScheduleExecutorImpl::ReturnJob(), CSampleNetScheduleClient::Run(), CSampleNetScheduleNode::Run(), s_DoParseGet2JobResponse(), s_ParseReadJobResponse(), CNetScheduleJobSerializer::SaveJobInput(), CNetScheduleJobSerializer::SaveJobOutput(), CGridClient::SetJobKey(), SJob::SJob(), CCgi2RCgiApp::SubmitJob(), SNetScheduleSubmitterImpl::SubmitJobImpl(), SGridWorkerNodeImpl::SJobsInProgress::Update(), CNetScheduleNotificationHandler::WaitForJobCompletion(), CJobCommitterThread::x_CommitJob(), CGridRPCBaseClient< CAsnBinCompressed >::x_GetJobById(), CMainLoopThread::x_GetNextJob(), SWorkerNodeJobContextImpl::x_RunJob(), and SOfflineJobContextImpl::x_RunJob().
◆ kGridCgiForm ◆ kPlainTextView ◆ m_AddJobIdToHeader bool CCgi2RCgiApp::m_AddJobIdToHeader private ◆ m_AffinityName string CCgi2RCgiApp::m_AffinityName private ◆ m_AffinitySetLimit int CCgi2RCgiApp::m_AffinitySetLimit private ◆ m_AffinitySource int CCgi2RCgiApp::m_AffinitySource private ◆ m_AppImpl ◆ m_AppNametemplate<typename TWorkerNodeJob >
◆ m_AutoCleanUp bool CGridClient::m_AutoCleanUp private ◆ m_BlobSize size_t CGridClient::m_BlobSize = 0 private ◆ m_CancelGoBackDelay int CCgi2RCgiApp::m_CancelGoBackDelay private ◆ m_CgiContext ◆ m_ContentType string CCgi2RCgiApp::m_ContentType private ◆ m_CustomHTTPHeader [1/2] CHTMLPage& CGridCgiContext::m_CustomHTTPHeader private ◆ m_CustomHTTPHeader [2/2] unique_ptr<CHTMLPage> CCgi2RCgiApp::m_CustomHTTPHeader private ◆ m_DateFormat string CCgi2RCgiApp::m_DateFormat private ◆ m_DisplayDonePage bool CCgi2RCgiApp::m_DisplayDonePage private ◆ m_ElapsedTimeFormat string CCgi2RCgiApp::m_ElapsedTimeFormat private ◆ m_Entries vector<SEntry> SInputValidator::m_Entries private ◆ m_ExceptionMessage ◆ m_FallBackDelay int CCgi2RCgiApp::m_FallBackDelay private ◆ m_FallBackUrl string CCgi2RCgiApp::m_FallBackUrl private ◆ m_FirstDelay [1/2] int CGridCgiApplication::m_FirstDelay private ◆ m_FirstDelay [2/2] int CCgi2RCgiApp::m_FirstDelay private ◆ m_Func function<void(const string&)> SInputValidator::SEntry::m_Func private ◆ m_GridClient [1/4] ◆ m_GridClient [2/4] ◆ m_GridClient [3/4] unique_ptr<CGridClient> CGridCgiApplication::m_GridClient private ◆ m_GridClient [4/4] ◆ m_GridRead ◆ m_GridWrite [1/2] ◆ m_GridWrite [2/2] ◆ m_HasBeenSubmitted bool CGridJobBatchSubmitter::m_HasBeenSubmitted private ◆ m_HostIPv4Addr unsigned CNetScheduleKeyGenerator::m_HostIPv4Addr privateDefinition at line 96 of file netschedule_key.hpp.
◆ m_HostName ◆ m_HtmlIncs vector<string> CCgi2RCgiApp::m_HtmlIncs private ◆ m_HTMLPassThrough bool CCgi2RCgiApp::m_HTMLPassThrough private ◆ m_HtmlTemplate string CCgi2RCgiApp::m_HtmlTemplate private ◆ m_IdleTasktemplate<typename TWorkerNodeJob , typename TWorkerNodeIdleTask >
unique_ptr<TWorkerNodeIdleTask> CSimpleJobFactoryEx< TWorkerNodeJob, TWorkerNodeIdleTask >::m_IdleTask private ◆ m_Impl [1/6]Definition at line 197 of file grid_worker.hpp.
Referenced by CWorkerNodeJobContext::CloseStreams(), CWorkerNodeJobContext::CommitJob(), CWorkerNodeJobContext::CommitJobWithFailure(), CWorkerNodeJobContext::GetCleanupEventSource(), CWorkerNodeJobContext::GetClientName(), CWorkerNodeJobContext::GetCommitStatus(), CWorkerNodeJobContext::GetInputBlobSize(), CWorkerNodeJobContext::GetIStream(), CWorkerNodeJobContext::GetJob(), CWorkerNodeJobContext::GetJobInput(), CWorkerNodeJobContext::GetJobKey(), CWorkerNodeJobContext::GetJobMask(), CWorkerNodeJobContext::GetJobNumber(), CWorkerNodeJobContext::GetJobOutput(), CWorkerNodeJobContext::GetOStream(), CWorkerNodeJobContext::GetQueueName(), CWorkerNodeJobContext::GetShutdownLevel(), CWorkerNodeJobContext::GetWorkerNode(), CWorkerNodeJobContext::IsJobCommitted(), CWorkerNodeJobContext::IsJobLost(), CWorkerNodeJobContext::IsLogRequested(), CWorkerNodeJobContext::JobDelayExpiration(), CWorkerNodeJobContext::PutProgressMessage(), CWorkerNodeJobContext::RequestExclusiveMode(), CWorkerNodeJobContext::RescheduleJob(), CWorkerNodeJobContext::ReturnJob(), CWorkerNodeJobContext::SetJobOutput(), and CWorkerNodeJobContext::SetJobRetCode().
◆ m_Impl [2/6]Definition at line 540 of file grid_worker.hpp.
Referenced by CGridWorkerNode::ForceSingleThread(), CGridWorkerNode::GetAppName(), CGridWorkerNode::GetAppVersion(), CGridWorkerNode::GetCheckStatusPeriod(), CGridWorkerNode::GetCleanupEventSource(), CGridWorkerNode::GetClientName(), CGridWorkerNode::GetCommitJobInterval(), CGridWorkerNode::GetJobFactory(), CGridWorkerNode::GetMaxThreads(), CGridWorkerNode::GetNetCacheAPI(), CGridWorkerNode::GetNetScheduleAPI(), CGridWorkerNode::GetNSExecutor(), CGridWorkerNode::GetQueueName(), CGridWorkerNode::GetQueueTimeout(), CGridWorkerNode::GetServiceName(), CGridWorkerNode::GetStartupTime(), CGridWorkerNode::GetTotalMemoryLimit(), CGridWorkerNode::GetTotalTimeLimit(), CGridWorkerNode::Init(), CGridWorkerNode::IsHostInAdminHostsList(), CGridWorkerNode::IsSuspended(), CGridWorkerNode::Resume(), CGridWorkerNode::Run(), CGridWorkerNode::SetListener(), and CGridWorkerNode::Suspend().
◆ m_Impl [3/6] ◆ m_Impl [4/6] ◆ m_Impl [5/6] ◆ m_Impl [6/6] ◆ m_InputValidator [1/2] ◆ m_InputValidator [2/2] ◆ m_InterceptJQueryCallback bool CCgi2RCgiApp::m_InterceptJQueryCallback private ◆ m_JobDefinition at line 269 of file grid_client.hpp.
Referenced by CGridClient::GetErrorMessage(), CGridClient::GetIStream(), CGridClient::GetJob(), CGridClient::GetJobInput(), CGridClient::GetJobOutput(), CGridClient::GetOStream(), CGridClient::GetProgressMessage(), CGridClient::GetReturnCode(), CGridClient::GetStatus(), CGridClient::SetJobAffinity(), CGridClient::SetJobGroup(), CGridClient::SetJobInput(), CGridClient::SetJobKey(), CGridClient::SetJobMask(), CGridClient::Submit(), CGridClient::SubmitAndWait(), CGridClient::x_CheckAllJobBlobs(), CGridClient::x_GetJobDetails(), and CGridClient::x_RenewAllJobBlobs().
◆ m_JobBatchSubmitter ◆ m_JobContext ◆ m_JobDetailsRead ◆ m_JobIndex size_t CGridJobBatchSubmitter::m_JobIndex private ◆ m_JobInput string CGridCgiContext::m_JobInput private ◆ m_JobKey string CGridCgiContext::m_JobKey private ◆ m_JobOutput string CGridCgiContext::m_JobOutput private ◆ m_Jobs ◆ m_JobVersiontemplate<typename TWorkerNodeJob >
◆ m_JqueryCallback string CGridCgiContext::m_JqueryCallback private ◆ m_NeedMetaRefresh bool CGridCgiContext::m_NeedMetaRefresh private ◆ m_NeedRenderPage bool CGridCgiContext::m_NeedRenderPage private ◆ m_NetCacheAPI [1/3] ◆ m_NetCacheAPI [2/3] ◆ m_NetCacheAPI [3/3] ◆ m_NetScheduleAPI ◆ m_NetScheduleSubmitter ◆ m_NSClient ◆ m_Page [1/3] ◆ m_Page [2/3] ◆ m_Page [3/3] ◆ m_ParsedQueryString ◆ m_PersistedEntries ◆ m_PersistentEntries ◆ m_Port unsigned short CNetScheduleKeyGenerator::m_Port privateDefinition at line 98 of file netschedule_key.hpp.
◆ m_PortAdded bool CCgi2RCgiApp::m_PortAdded private ◆ m_ProgressMsg string CGridCgiContext::m_ProgressMsg private ◆ m_QueueName ◆ m_RefreshDelay [1/2] int CGridCgiApplication::m_RefreshDelay private ◆ m_RefreshDelay [2/2] int CCgi2RCgiApp::m_RefreshDelay private ◆ m_RefreshWait int CCgi2RCgiApp::m_RefreshWait private ◆ m_Registry ◆ m_Response [1/2] ◆ m_Response [2/2] ◆ m_RunAgain bool CWorkerNodeIdleTaskContext::m_RunAgain private ◆ m_TargetEncodeMode ◆ m_Thread ◆ m_Title ◆ m_UseIPv4Addr ◆ m_UseProgress bool CGridClient::m_UseProgress private ◆ m_V1HostPortQueue ◆ m_Validated bool SInputValidator::SEntry::m_Validated = false private ◆ m_WorkerNodeInitContexttemplate<typename TWorkerNodeJob >
◆ mask ◆ max_input_size size_t CNetScheduleAPI::SServerParams::max_input_size ◆ max_output_size size_t CNetScheduleAPI::SServerParams::max_output_size ◆ name string SInputValidator::SEntry::name ◆ output string CNetScheduleJob::outputJob result data.
Definition at line 373 of file netschedule_api.hpp.
Referenced by CGridRPCBaseClient< CAsnBinCompressed >::Ask(), CGridRPCBaseClient< CAsnBinCompressed >::AskStream(), CGridCommandLineInterfaceApp::Cmd_CommitJob(), CGridCommandLineInterfaceApp::Cmd_GetJobOutput(), CGridCommandLineInterfaceApp::Cmd_ReadJob(), CGridCommandLineInterfaceApp::Cmd_SubmitJob(), g_ProcessJobInfo(), CGridClient::GetIStream(), CNetScheduleAPI::GetJobDetails(), CGridClient::GetJobOutput(), SWorkerNodeJobContextImpl::GetOStream(), CGridCommandLineInterfaceApp::NetScheduleSanityCheck(), CNetScheduleExecutor::PutFailure(), CNetScheduleExecutor::PutResult(), CNetScheduleJob::Reset(), CSampleNetScheduleClient::Run(), CSampleNetScheduleNode::Run(), CNetScheduleJobSerializer::SaveJobOutput(), CGridRPCBaseClient< CAsnBinCompressed >::x_GetJobById(), and CGridClient::x_RenewAllJobBlobs().
◆ page_hit_id string CNetScheduleJob::page_hit_id ◆ port unsigned short CNetScheduleKey::port ◆ progress_msg string CNetScheduleJob::progress_msg ◆ progress_msg_truncated ◆ queue ◆ ret_code int CNetScheduleJob::ret_codeJob return code.
Definition at line 371 of file netschedule_api.hpp.
Referenced by CGridCommandLineInterfaceApp::Cmd_CommitJob(), CNetScheduleAPI::GetJobDetails(), CGridClient::GetReturnCode(), CGridCommandLineInterfaceApp::NetScheduleSanityCheck(), CNetScheduleExecutor::PutFailure(), CNetScheduleExecutor::PutResult(), CNetScheduleJob::Reset(), CSampleNetScheduleClient::Run(), CNetScheduleJobSerializer::SaveJobOutput(), SWorkerNodeJobContextImpl::x_PrintRequestStop(), and SWorkerNodeJobContextImpl::x_RunJob().
◆ server ◆ session_id string CNetScheduleJob::session_id ◆ status ◆ version unsigned CNetScheduleKey::version ◆ CCgiWorkerNodeJob ◆ CGridCgiApplication ◆ CGridClient ◆ CWorkerNodeIdleThread ◆ operator<<RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4