Melissa Data - Data Quality Components for SQL Server
Data Quality Components for SQL Server are enterprise plugins for SQL Server Integration Services (SSIS) that enable users to verify, standardize, match, consolidate, enhance, and update U.S., Canadian and global contact data including postal addresses, emails, phone numbers and full names. Other capabilities include geocoding, which appends rooftop lat/long coordinates to a street address, and powerful Fuzzy Matching algorithms to link similar records.
As a production Database Administrator, I do not want to give Developers direct access to the SQL Server Agent job log especially for servers in the DMZ. Another problem we have is that when there is a lot of log data for a job, the default job log doesn't contain the full log detail and that makes it harder to troubleshoot. Most of all, we are trying not to use a different code set for deployment based on the environment. Basically we want to use the same methods to deploy our jobs to Development, Test and Production.
Now using verbose SQL Agent logging, we can save the output file locally or to a shared folder and provide Read Only permissions for Developers. Another thing we did was to use SQL Tokens, so with the same code we could pick up the server name and other variables to dynamically generate the output file name.
What is SQL Token?
Here is the definition from books online. "SQL Server Agent allows you to use tokens in Transact-SQL job step scripts. Using tokens when you write your job steps gives you the same flexibility that variables provide when you write software programs. After you insert a token in a job step script, SQL Server Agent replaces the token at run time, before the job step is executed by the Transact-SQL subsystem". You can find more information about Tokens here Use Tokens in Job Steps.
IMPORTANT NOTE: The format of Tokens was changed in SQL 2005 SP1 and later, so be aware of the formatting differences as shown below.
Pre-requisite - Turn on Token Replacement
Before you use Tokens, you must turn on the "Token Replacement" property.
You can easily do this from a T-SQL Script"
EXEC msdb.dbo.sp_set_sqlagent_properties @alert_replace_runtime_tokens=1
Or via SSMS, by right clicking on SQL Server Agent and selecting Properties and then change as shown below:
Implementation - SQL Server Management Studio
When you create a job step, click the "Advanced" page and you will see Transact-SQL script (T-SQL) Output file as shown below.
Here is an example job setup, notice the difference for SQL 2005 and higher and SQL 2000.
Server name: SQLTIP1\SQL2012A
Job name: DBA - SQL Token Testing
Step name: SQL Token Test
Output file format SQL 2005 SP1 or higher \\MYFILESERVER\SQLLogs\$(ESCAPE_NONE(MACH))_$(ESCAPE_NONE(INST))\SQLTokenTest_Step1_$(ESCAPE_NONE(DATE)).log
Output file format - SQL 2000 \\Myfileserver\SQLLogs\[MACH]_[INST]\SQLTokenTest_Step1_[DATE].log
The output file will be generated in \\Myfileserver\sqllogs\SQLTIP1_SQL2012A\ folder and as you can see I didn't need to specify the server name, but it was dynamically generated by the "\$(ESCAPE_NONE(MACH))_$(ESCAPE_NONE(INST))\" token.
And the file name also includes the [year], [month] and [day] as shown below.
Implementation - T-SQL Script (SQL 2005 sp1 or higher)
Here is T-SQL code to create a job. This script includes the Tokens, so that I can run this same script on multiple servers without having to make any changes and the tokens will be replaced with the actual values from the server when the job is run.
It’s a nice Article, I check suggested articles: Verbose SQL Server Agent Logging and How to store longer SQL Agent Job Step output messages. The main Idea is to help a developer to know, what happen if a job fails during execution.
An easy Solution: Add an extra step to the job "If the job Fails" to monitor it. Create a store procedure with the below code, looking for last know job issue and send it by email to your developer.