Lotus Notes attachment using Perl

Hi all,
i would like to use perl script (not satisfied with Lotus notes scripting) to store attachments from mail database within assigned folder (like C:\MAIL), not overwriting attachment with the same name and finally deleting the attachment or whole email from mail database.
Is there anybody who could help me?
lebenoAsked:
Who is Participating?

[Webinar] Streamline your web hosting managementRegister Today

x
 
Sjef BosmanConnect With a Mentor Groupware ConsultantCommented:
Maybe he's not allowed to run restricted agents, as configured in the Security section of the Server document. Next, I'd love to see your code, because maybe it isn't correct for a background agent (for instance, there should not be a NotesUIWorkspace).

Finally, if the Admins are a PITA, and his CIO hates his guts, I see only one real alternative: get the hell out of there. Stuff them!
0
 
mbonaciCommented:
0
 
mbonaciCommented:
0
Learn to develop an Android App

Want to increase your earning potential in 2018? Pad your resume with app building experience. Learn how with this hands-on course.

 
lebenoAuthor Commented:
I have seen these scripts and tested, but there is no deletion added. Due to fact my perl skills are really poor, I'm not able to modify that.
0
 
mbonaciCommented:
To delete attachments from document use this on each doc:

$doc->RemoveItem("$File")

If your perl is poor why didn't you cross-post to Perl zone?


Wait a minute, you said you're "not satisfied with Lotus notes scripting" and the you choose to use perl, for which you said you don't have skills?


OK, lets put this right, tell me what are you good at, and I'll help you do that in the language of your choice.
0
 
lebenoAuthor Commented:
I'm fine with DOS scripting or vbs. I would love lotus notes scripting also, but ended on lack of permissions at LN server, where I couldn't schedule the agent.
This perl script would give me what I need, it's just one time issue.
and this is what I could modified form the origin script :
#
use strict;
use English;
use warnings;
use vars qw($opt_d $opt_v);
use charnames ':full';
use Getopt::Std;
use Win32::OLE;
use Win32;

# Command-line options:
# -d dirname    Save everything under the directory "dirname"
# -v            Verbose reporting of progress
getopt("d");

# Define a directory to store the results
my $dir = $opt_d || Win32::GetFolderPath(Win32::CSIDL_PERSONAL) . '\\Notes2Files';
my $Counter = 1;

# Define a list of "Normal" folders to skip
my @badlist = ('Sent', 'Archiving\\Age of Documents',
               'Discussion Threads', 'Events', 'All by Purge Date', 'Stationery');

# Auto-print carriage returns
$OUTPUT_RECORD_SEPARATOR = "\n";

# Open the email database in Lotus Notes
# (To use another person's email database, switch to
#  their userid in Notes before running this program)
my $notes = Win32::OLE->new('Notes.NotesSession')
             or die "Can't open Lotus Notes";
my $database = $notes->GetDatabase("","");
$database->OpenMail;

# Verify the server connection
print "Connected to ", $database->{Title},
      " on ", $database->{Server} if $opt_v;

# Loop over all of the folders
foreach my $viewname (GetViews($database)) {

  # Get the object for this View
  print "Saving Messages in folder $viewname...";
  my $view = $database->GetView($viewname);

  # Create a subdirectory to store the messages in
  $viewname =~ tr/()$//d;
  $viewname =~ s(\\)(.)g;

 my $path = 'D:\Archives';
  mkdir ($path, 0755)
      or die "Can't make directory $path: $!";
  chdir ($path);

  # Get the first document in the folder
  my $num = 1;
  my $doc = $view->GetFirstDocument;
  next unless $doc;
  GetInfo($num, $path, $doc);

  # Get the remaining documents in the folder
  while ($doc = $view->GetNextDocument($doc)) {
    $num++;
    GetInfo($num, $path, $doc);
  }
}

sub GetInfo {
  my ($num, $path, $doc) = @_;

print "Processing message $num";

if ( $doc->HasEmbedded ) {
 
      my $DocumentBody = $doc->GetFirstItem('Body');

      foreach my $embeddedDoc ( $DocumentBody->{EmbeddedObjects} ) {
         foreach my $arryele ( @{$embeddedDoc } ) {
           my @array = $arryele->{Source};
           ExtractAttachment($doc, "$path", @array);
         }
       }
    }
   
}

sub ExtractAttachment {
 my ($doc, $path, $filename) = @_;
 
 $Counter = $Counter + 1;
 
 #Get a Windows-friendly pathname for the file
  $path = "$path/$Counter-$filename";
  $path =~ tr/\//\\/;

print "Extracting attachment $path";

  # Save the attachment to a file
  my $attachment = $doc->GetAttachment($filename);
  eval { $attachment->ExtractFile($path);
$doc->RemoveItem("$filename")};
  if($?)
     {
     print("Error Saving Attachment:$filename:$?:$!:$@:$^E\n");
     }
#$doc->RemoveItem("$filename") or die ("Unable to remove\n");
}


sub GetViews {
  my ($database) = @_;
  my @views = ();

  # Loop through all of the views in this database
  my $array_ref = $database->{Views};
  foreach my $view (@$array_ref) {
    my $name = $view->{Name};

    # We only want folders if it's the Inbox or Sent
    # or a normal folder name with no parentheses
    if ( ($name =~ "TRANSFER"))
      {
      # Add the folder name to the @views list
      # if it's not in the @badlist
      push(@views, $name) unless (grep { $name eq $_ } @badlist);
      }
  }

  return @views;
}
xxxxxxxxxxxxxxxxxxxxxxxxxx
could u correct it 4me?
0
 
mbonaciCommented:
But you'll have the same access problem no matter which programming language you use.

This perl script is simply using Lotus exposed OLE classes.
0
 
Sjef BosmanGroupware ConsultantCommented:
And if you want to delete an attachment you need write permission in the user's database. Since the attachment is inside a mail document, and you remove the attachment, you have to save the document which requires write permission.

In what database is this? Is it some action you want to run every x minutes, on specific mails (I don't read Poil), to fetch incoming attachments?
0
 
lebenoAuthor Commented:
i have the manager rights on this mail file as I could see it at ACL. To delete whole email with embedded attachment is also fine. There is no necessity to keep the body without attachment.
what is the purpose... there are random incoming emails with attachment (simple plain text files). I need to download these attachment and to upload to oracle database. Emails keep fixed subject suffix REPORT_DB_timestamp, the same as the name of attachment.  I've created the rule in mailbox to forward these mails to assigned folder ('cause I didn't know how to add dedicated view into perl script, or how to filter emails according subject), in the script it's TRANSFER.
At this moment I'm able to download the attachments (can run every 5 mins) - this is running fine  but have to avoid downloading the same attach. more times.
0
 
Sjef BosmanGroupware ConsultantCommented:
Why don't you forward the whole mail to the Oracle environment? I assume Oracle can receive mails...
0
 
lebenoAuthor Commented:
i have only the experience with sending emails from ora, but opposite direction?? could be a way..let's do some research
0
 
Sjef BosmanGroupware ConsultantCommented:
I have no knowledge of Oracle systems whatsoever, but this seems a reasonably clear document:
http://download-uk.oracle.com/docs/cd/B14099_19/integrate.1012/b12160/instal24.htm#mlrinbnd
Whether it can be applied to your situation...?
0
 
mbonaciCommented:
The easiest solution here would be to have a mail triggered agent in Lotus db that detaches attachment to a specified network location.
On the other side, in Oracle, you can do two different things, either set up:
    - SOA approach:   web service that would be called by Lotus agent (to signal new attachment arrival)
    - old school:          stored procedure that would run on schedule and check the network location for files
0
 
Sjef BosmanGroupware ConsultantCommented:
I assume the asker is trying to avoid Lotus programming...
0
 
mbonaciCommented:
Same here, but it then turned out that he avoided it because he thought that security could be bypassed by using perl.
0
 
Sjef BosmanGroupware ConsultantCommented:
So maybe he can still avoid it by doing everything from Oracle. If Oracle can somehow receive and handle mails... Seems this is one more advantage of Domino over Oracle! ;-)
0
 
lebenoAuthor Commented:
To be honest, LN agent would be better solution 'cause no need to have LN client opened while detaching attachment, for perl script it's mandatory. I have modified LN agent found in e-e site which was working fine but only using manual start, not scheduled via time frame or action (after new mail arrival).  I deemed the problem could be the scheduled agent run at server side and therefore ln server didn't have the permissions to my folder destination.
I'm afraid with Oracle it could more complicated, but any way is acceptable.
0
 
Sjef BosmanGroupware ConsultantCommented:
I agree that an agent is probably best. A scheduled agent always runs on the server, so you would have to use an open server directory to save the attachment, e.g. a Temp directory.
0
 
lebenoAuthor Commented:
and this is my problem " to get such a server directory, our 2nd level LN admins are not willing to cooperate.
Next idea could to be to use the current perl script with a small correction : change the prefix of the file name ($path = "$path/$Counter-$filename") - not to use counter but someting like xxx_ so my sqlloader would ignore duplicates.
to have more options is better then nothing:)
0
 
Sjef BosmanGroupware ConsultantCommented:
Not willing to cooperate?? How dare they?! Send them a mail, CC to your boss, explaining in detail what you want (e.g. a private temp. directory on the server), and ask them their formal reply. If you're not satisfied, send your request to your boss, CC them, and walk the hierarchy, up to the CIO if need be. Admins like that drive me insane! They think they're there to protect their realm instead of helping their colleagues.

It is the Notes agent that's not allowed to save a file on the file system? Well, ask them to sign the agent, or demand a full explanation why they don't want it.
0
 
mbonaciCommented:
I don't understand your last comment, the directory doesn't have to be on the Domino server file system, any shared network folder will do.
Tell them you'll give them the code yourself, what a hell, right :)
0
 
Sjef BosmanGroupware ConsultantCommented:
AFAIK Marko, a restricted agent can't write files at all... I suppose that's the real problem here.
0
 
mbonaciCommented:
I was commenting this sentence:
and this is my problem " to get such a server directory, our 2nd level LN admins are not willing to cooperate.

And you're right Sjef, of course, but why wouldn't we allow that agent to run restricted operations (agent properties), we already have to change its code, don't we (folder path)?
0
 
lebenoAuthor Commented:
Company hierarchy is not usable, I'm representative of subsidiary, and CIO hates me...
I have used common widows share, but ln agent works only with manual start therefore I deemed it has to be Domino share. I have also tried different agent settings without success.
I will provide u the ln agent on Thue, maybe I do something wrong.
0
 
mbonaciCommented:
First you need to do is change agent property "Set runtime agent security" to "Allow restricted operations".
Post the code, of course...
0
 
lebenoAuthor Commented:
Here is the ln agent used :
Sub Initialize
      Dim session As New NotesSession
      Dim db As NotesDatabase
      Dim object As NotesEmbeddedObject
      Dim collection As NotesDocumentCollection
      Dim doc As NotesDocument
      Dim downloadfolder As String
      
      Set db = session.CurrentDatabase
      Set collection = db.UnprocessedDocuments
      
      downloadfolder = "\\10.76.2.20\ln\users\"
      'If Dir("\\10.76.2.20\ln",16)="" Then Mkdir "\\10.76.2.20\ln"
      If Dir("\\10.76.2.20\ln\users",16)="" Then Mkdir "\\10.76.2.20\ln\users"
      
      Print "************************************************************************"
      For i = 1 To collection.Count
            Set doc = collection.GetNthDocument( i )
            filen=Evaluate("@AttachmentNames",doc)
            antalfiler=Evaluate("@Attachments", doc)
            UserName=db.FileName
            If Dir("\\10.76.2.20\ln\users\"+username,16)="" Then Mkdir "\\10.76.2.20\ln\users\"+username
            
            Print Str(i)+" ("+Str(collection.count)+")"
            
            If antalfiler(0)>0 Then
                  For filecounter=0 To antalfiler(0)-1
                        x=x+1
                        Print ( filen(filecounter))
                        Set Object = doc.GetAttachment( filen(filecounter) )
                        If ( object.Type = EMBED_ATTACHMENT ) Then
                              fileCount = fileCount + 1
                              If Dir(downloadfolder+username+"\"+ filen(filecounter))="" Then
                                    extrachar=""
                              Else
                                    extrachar=Left(doc.universalid,4)+"---" 'in case attachmnet with same name exists in several documents
                              End If
                              Call object.ExtractFile (downloadfolder+"\"+username+"\"+extrachar+ filen(filecounter) )
' Call object.Remove 'delete the attachment from document
' Call doc.Save( True, False )
                        End If
                  Next filecounter
            End If
            
      Next
      
      'Msgbox"Attachments: "+Str(fileCount )
      
End Sub

Settings : scheduled to run every 5 mins
       Runtime level : 2.Allow restricted operations
ACL : User type : Person
         Access : Manager
   Attributes enabled : Create documents, Delete Documents, Create private agents, Create personal folders/views, Create shared folders/views, Create LotusScript/JAVA agents, Read public documents, Write public documents, Replicate or copy documents
0
 
mbonaciCommented:
At a first glance the code looks fine.
What happens when you run it?
You can temporarily make the agent triggered by action (not schedule) so you can test it.

Are you allowed to run restricted agents on your server (see Sjef's last comment)?
0
 
Sjef BosmanGroupware ConsultantCommented:
Are there any error messages in the log.nsf database, under Miscellaneous?

What could be clever in the meantime is to add some error catching code.

At the start, add the line
      On Error Goto oops

At the end, before the End Sub, add the lines

exitsub:
      Exit Sub
oops:
      MsgBox "Error on line " & Erl & ": " & Error$
      Resume exitsub

Wait till the modified agent has run once, and check the log database if there's an error in it.
0
 
lebenoAuthor Commented:
There are no errors in log.nsf, I had just issue with encypted mail content. I've checked Domino directory and it's bad :       
Sign or run restricted LotusScript/Java agents:      $Admin.FirstClass
                                                                                     LocalDomainServers
it is the same in all items. I'm not in the right group. So it looks like I can only thank you both for excellent support many times and whimper ln admins...Am I wrong?
0
 
mbonaciCommented:
You're right, you'd have to be in that group in order to run unrestricted agents on that server.
0
 
lebenoAuthor Commented:
OK,I'm going to fight for my rights:)
Could u just help me to modify the agent to run only for dedicated view?
0
 
mbonaciCommented:
The problem is not related to views, saving files to file system is considered to be a restricted operation by Lotus, so that is your problem, you cannot manipulate file system from your agent.
0
 
lebenoAuthor Commented:
I'm aware of that now, I just wanted to modify the agent before I start the dealing with ln admins for case that they will refuse my request and I will be force to ask to sign the agent by them.
On the other hand when I run Agent test, I get this message :

The following will occur when this agent is run:

'CN=username/OU=GDSK/O=GuD' has unrestricted rights to run LotusScript/Java agents on 'CN=servername/OU=SRV/O=GuD'.
Allow restricted operations flag is selected. Restriction operations will be allowed.
Agent scheduled to run on 'CN=servername/OU=SRV/O=GuD'.
0
 
mbonaciCommented:
AFAICS, that means that you were given the rights to run unrestricted agents on that server.

I don't understand what's wrong with them signing the agent?
0
 
lebenoAuthor Commented:
There two points :
- there is difference between Domino directory and the agent test result. Is that fine?
- that was just an idea to sign the agent in case of lack of rights, but due to first point I'm quite confused where the problem is
0
 
mbonaciConnect With a Mentor Commented:
To change the agent scope simply make it run on "All documents in a view", as opposed to "All documents in a database".
Also change the trigger: On event - Action menu selection.

Then turn debugger on, open your database and run the agent using Actions menu.

Use step-into to execute code line by line.
0
 
lebenoAuthor Commented:
our ln admins has signed my agent and the result is : Agent will not run, scheduled to run on 'CN=NOTES....
This is other story.
Thank u both gentlemen for excelent and quick support.
0
All Courses

From novice to tech pro — start learning today.