Presentation Screenshots Download Support Development Forum    
   

Welcome to the Community Forum.

Here you can discuss with other users or with the author, suggest new features, report bugs, ask for filters creation or correction, etc. Select the forum you wish to read or post below :

Forum
Forum > Filters repository > Filter based on Url parameter

Pages : 1 2 [3] Add a reply
User info Filter based on Url parameter
hiteshsathawane
Avatar
Feb 19 2012, 8:54 pm
Hi Thanks for the bita version,

I will check it and let you know.

Post #21
Edit
hiteshsathawane
Avatar
Feb 20 2012, 11:38 am
Hi Cyan,

Following are the logs of downloaded document.

Automatic Save Folder :
These data will be used to verify the filters :
Filename: getdocstream
Domain test order: 7
1 - File's domain: http://192.9.200.217
2 - File's URL: http://192.9.200.217/omnidocs/servlet/
3 - Full file's URL: http://192.9.200.217/omnidocs/servlet/getdocstream
4 - Page's domain:
5 - Page's URL: about:blank
6 - Page's referrer:
7 - Tab's URL content: 192.9.200.217/omnidocs/servlet/getdocstream?ImgCabinetName=HUTCHMUM&JtsIpAdd=10.87.129.70&JtsPort=3333&VolId=31&SiteId=3&ImageId=4021748&docExt=tif&Option=DocView&PageNo=1&DocId=177048136

Automatic Save Folder :
Filter 0 matched domain type : 7

Automatic Save Folder :
Filter 0 is matching both domain and filename.
Domain: DocId=(*)
Filename: *
Folder: C:\KOL_ROB_RECON\Export\$1d

Automatic Save Folder :
save location changed to: C:\KOL_ROB_RECON\Export\$1d

A wrong folder is created in the export path.
Please check it.

Even when I try to edit your code of 1.0.4 I received same error. I fixed it with adding the code for filter to that in method createfolder.

But I was had one more problem even after fixing it, example when i hit 20 urls with difference of 1 sec each, multiple document's are downloaded in one folder, if we add total documents we can find more than 20 documents. did not understand what was remaining in the code.

Regards
Hitesh Sathawane
Post #22
Edit
Cyan
Avatar
Feb 20 2012, 4:58 pm
I'll check why the $1d didn't use the capture element.

Maybe try with regular expression :
.*DocId=(.*)


I'll check it in few hours and let you know.
Post #23
Edit
Cyan
Avatar
Feb 20 2012, 6:02 pm
I tested a filter, and I got the same problem.
when using "7", it's not replacing the $1d, but it works fine when the 1-5 Domain Type are matching.
I forgot to add the new type to the replacing function.

I'll check the source and fix it, and give you another beta.
Thanks for the report. :)



Edit:
Please try r117 (I removed r116).


I also changed the way the website's informations are read by ASF.
It shouldn't create any problem, but just in case let me know if you still find some problem.

I think r117 is the final working version for you :)
Post #24
Edit
hiteshsathawane
Avatar
Feb 21 2012, 2:54 pm
Hi


I had tested this addon, now the folders are getting created but still I could find some problem,

i.e. I try to hit 100 URL's sequentially with difference of 2 seconds each, I could find total 98 documents amongst which 92 folders where created (concidering that the docid is unique identity of document) which means 6 documents where placed in wrong folders. I think the streme should be associated with the URL which is been used. I exactly dont know about what is to be changed in the code.

Regards
Hitesh Sathawane
Post #25
Edit
Cyan
Avatar
Feb 21 2012, 4:56 pm
Hi,

I can just guess that the files saved in the incorrect folder is caused by Firefox setting the saved path to the last downloaded file, bypassing the ASF setting for the previous and still downloading file.
I don't know if Firefox set the save path on download starts or ends.



I would be curious to see your current logs of 100 files to check if all folders was correctly set by ASF or not.
If ASF set all the folders correctly, then it's Firefox's fault.


If it's a problem of ASF, I don't know what I can change to speed the saving process :(
Maybe you could try to disable the logs to the error console. (it's enabled by default, you can edit the log setting in the source : asf_download.js line 32

but if it's a problem of file size and time to complete a download, then I can't do anything as ASF is not saving the files itself, it's still Firefox which do it (not like DownThemAll! which has his own download manager).
Post #26
Edit
hiteshsathawane
Avatar
Jul 3 2014, 2:49 pm
Hi Cyan,

We have to perform the same kind of job again and I m finding all new versions of Firefox and ASF.

I have tried the same operation with latest version I am not getting desired output Please find the logs below.

I am trying to generate the folder with name 2113658 coming from the below mentioned URL in logs

I am selecting Domain Fileter=DocId=(*)
and File Filter blank
location of folder C:\Users\IBM_ADMIN\Desktop\OMNIDOCS\$1d\



Quote :
[08:39:41.034] GET http://172.30.1.250:9080/omnidocs/servlet/getdocstream?ImgCabinetName=mhomni&JtsIpAdd=172.30.1.250&JtsPort=3333&VolId=3&SiteId=1&ImageId=210394&docExt=tif&Option=DocView&PageNo=1&FolderId=1468136&J2EE=1&DocId=2113658 [HTTP/1.1 200 OK 954ms]
[08:39:41.161] Automatic Save Folder :
These data will be used to verify the filters :
Filename: getdocstream
Domain test order: 1,2,3,4,5,6,7
1 - File's domain: http://172.30.1.250:9080
2 - File's URL: http://172.30.1.250:9080/omnidocs/servlet/
3 - Full file's URL: http://172.30.1.250:9080/omnidocs/servlet/getdocstream
4 - Page's domain:
5 - Page's URL: about:blank
6 - Page's referrer:
7 - Tab's URL content: 172.30.1.250:9080/omnidocs/servlet/getdocstream?ImgCabinetName=mhomni&JtsIpAdd=172.30.1.250&JtsPort=3333&VolId=3&SiteId=1&ImageId=210394&docExt=tif&Option=DocView&PageNo=1&FolderId=1468136&J2EE=1&DocId=2113658
8 - Tab's group name:
[08:39:41.162] Automatic Save Folder :
Filter 0 matched domain type : 7
[08:39:41.163] Automatic Save Folder :
No filter matched both domain and filename. These data will be used instead :
Folder: C:\Users\IBM_ADMIN\Desktop\OMNIDOCS
%asf_d%: 172.30.1.250:9080
%asf_f%: getdocstream
[08:39:41.164] Automatic Save Folder :
save location for 172.30.1.250:9080 changed to: C:\Users\IBM_ADMIN\Desktop\OMNIDOCS\$1f



I really do not understand form where $1f comes from.
Can you please help me with solving this issue.

I was grateful to you for the past efforts you had put for us.

Regards
Hitesh
Post #27
Edit
Cyan
Avatar
Aug 23 2014, 1:45 pm
Sorry for the late answer, I don't come here often.

When setting $1d you get $1f ?
There's probably a mistake in my code. I will take a look, thanks for the report.
I'll come back to you after checking it.
Post #28
Edit
Cyan
Avatar
Aug 29 2014, 7:36 pm
Hi,


I tried to create a filter like you :
Filters Domain
All    
= Regexp.
File name
All    
= Regexp.
Local folder


I set the check order to 7,1,3,5,6,8
so it should check the URL located in the tab first.

I save the current page (this forum page with ctrl+s)

and as a result:

Quote :
Automatic Save Folder :
These data will be used to verify the filters :
Filename: Automatic Save Folder
Domain test order: 7,1,3,5,6,8
1 - File's domain: http://asf.mangaheart.org
2 - File's URL: http://asf.mangaheart.org/
3 - Full file's URL: http://asf.mangaheart.org/?menu=5&f=3&t=107&p=3#post28
4 - Page's domain: http://asf.mangaheart.org
5 - Page's URL: http://asf.mangaheart.org/?menu=5&f=3&t=107&p=3#post28
6 - Page's referrer: http://asf.mangaheart.org/?menu=5&f=3
7 - Tab's URL content: asf.mangaheart.org/?menu=5&f=3&t=107&p=3#post28
8 - Tab's group name:

Automatic Save Folder :
Filter 0 matched domain type : 7

Automatic Save Folder :
Filter 0 matched domain type : 3

Automatic Save Folder :
Filter 0 is matching both domain and filename.
Domain: p=3#(*)
Filename: *
Folder: F:\firefox\$1d\
Automatic Save Folder :
save location for asf.mangaheart.org changed to: F:\firefox\post28



1- The $1d is correctly replaced with "post28" (the end of the URL)
2- Domain type 7 is matching, but it shouldn't test domain type 3 if Type 7 was good.


So you have an error I don't have (catch argument not replaced), and I have an issue with domain type7 matching but still continuing to test domain type 3.

I will see if I can find the issue.


Edit:
I found a missing "break;" in the code. It's fixing issue2.
But I don't know if it's enough to fix your issue.


Edit:
I released a new revision (r128).


Post #29
Edit / Delete
Pages : 1 2 [3] Add a reply

Return to top