heckyel/mediagoblin
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,979 Commits 1 Branch 0 Tags
Commit Graph

57 Commits

Author SHA1 Message Date
Boris Bobrov
41076dc96b Fix occurence of unicode() 
Fix unicode() -> six.text_type()
 2016-02-01 01:43:36 +01:00
Boris Bobrov
a2608d6b59 changes to BaseProcessingFail arguments usage 2016-02-01 00:30:32 +01:00
Boris Bobrov
e3663c7be1 changed the way we save information about exceptions 2016-01-28 22:04:44 +01:00
Boris Bobrov
945a1c5667 a tiny fix to function doc 2015-02-16 13:41:09 +03:00
Boris Bobrov
91f5f5e791 Porting video to GStreamer 1.0 
Porting includes:
 - thumbnailer
 - transcoder
 - metadata handling
 - new common discoverer for media
 - new tests with in-memory test video generating
 - handling regardless of audio availability in the file
 - Pythonic gst pipelines
 2015-02-16 05:35:36 +03:00
Berker Peksag
e49b7e02b2 Use six.text_type instead of unicode(). 
I will be switch to use ``from __future__ import unicode_literals`` later.
 2014-06-02 20:59:28 +03:00
Sebastian Spaeth
a42dda21f9 Merge branch 'master' into upstream-master 
Conflicts:
	mediagoblin/templates/mediagoblin/base.html
	mediagoblin/templates/mediagoblin/user_pages/user.html
 2013-12-12 16:24:34 +01:00
Christopher Allan Webber
70fe865647 Oh god how did I leave a pdb.set_trace() in here 
Well, cleaning that up :)

This commit sponsored by Enrico Zini.  Thanks!
 2013-11-10 17:35:56 -06:00
Aditi Mittal
728516261a Merge branch 'master' of git://gitorious.org/mediagoblin/mediagoblin 2013-09-09 21:53:56 +05:30
Christopher Allan Webber
66cafc3b74 Support python 2.6 again! Thanks to julianoliver for catching this. 
This commit sponsored by Sam Clegg.  Thank you!
 2013-09-09 10:06:59 -05:00
Aditi Mittal
f242807518 Merge branch 'master' of git://gitorious.org/mediagoblin/mediagoblin 2013-09-05 22:45:10 +05:30
Rodney Ewing
6375cf735c should use public_store.file_exists to check if the file copied correctly 2013-09-02 12:09:55 -07:00
Aditi
7d9dbe32cc Merge branch 'master' of git://gitorious.org/mediagoblin/mediagoblin 2013-08-25 09:24:13 +05:30
Christopher Allan Webber
f6497ce572 Merge remote-tracking branch 'refs/remotes/rodney757/reprocessing' 
Conflicts:
	mediagoblin/processing/task.py
	mediagoblin/submit/lib.py
 2013-08-21 12:39:38 -05:00
Rodney Ewing
b505952508 -update to latest master 
- have mg generate task_id

remove
 2013-08-19 15:26:06 -07:00
Sebastian Spaeth
bf2dafd1a0 Tweak Celery Task 
- Make sure Exceptions are pickleable (not sure if this was not the
  case but this is the pattern as documented in the celery docs.
- Don't create a task_id in the GMG code, but save the one
  implicitely created by celery.
- Don't create a task-id directory per upload. Just store queued uploads
  in a single directory (this is the most controversial change and might
  need discussion!!!)

Signed-off-by: Sebastian Spaeth <Sebastian@SSpaeth.de>
 2013-08-19 14:42:13 -07:00
Rodney Ewing
1cefccc755 refactor get_orig_filename to return an acceptable filename to the processor. 
If there is an original video file and we skip transcoding, delete the webm_640 file
 2013-08-16 15:30:23 -07:00
Rodney Ewing
882779f547 only try and delete queue file if it exists 2013-08-16 15:30:23 -07:00
Rodney Ewing
79f84d7e47 raise an error if the file failed to copy to public storage 
catch copy_local_to_storage errors and raise PublicStoreFail, saving the keyname
 2013-08-16 15:30:22 -07:00
Rodney Ewing
4e6013689b run initial processing on all failed entries 2013-08-16 15:30:18 -07:00
Rodney Ewing
7584080bf7 add bulk_run, thumbs, and initial sub_commands 2013-08-16 15:30:18 -07:00
Rodney Ewing
455f71d24c remove ProcessingState 2013-08-16 15:30:18 -07:00
Rodney Ewing
fb56676bf4 delete existing file in store_public 2013-08-16 15:30:17 -07:00
Rodney Ewing
583501415a Add image resizer and some cleanup of old code 2013-08-16 15:30:17 -07:00
Christopher Allan Webber
98d1fa3bed Fixing normal submission of media (well for images anyway) 2013-08-16 15:30:17 -07:00
Christopher Allan Webber
7a85bf985d Fixing the MediaProcessor context manager so it actually, you know, works :) 
This commit sponsored by Mikiya Okuno.  Thank you!
 2013-08-16 15:30:17 -07:00
Christopher Allan Webber
5fd239fa58 Theoretically the last steps to get reprocessing working for initial & images 
Haven't tested it yet though :)

This commit sponsored by Samuel Bächler.  Thank you!
 2013-08-16 15:30:16 -07:00
Christopher Allan Webber
eb372949a1 Factored the get_orig_filename from processing state and put it to use. 
This commit sponsored by Vincent Demeester.  Thank you!
 2013-08-16 15:30:16 -07:00
Christopher Allan Webber
22479c39a0 Record the original state of the media entry in the processor 
This allows our processor to make some informed decisions based on the
state by still having access to the original state.

This commit sponsored by William Rico.  Thank you!
 2013-08-16 15:30:16 -07:00
Christopher Allan Webber
55cfa34063 Renaming the processing manager stuff to be less ambiguous. 
BONUS COMMIT to Ben Finney and the Free Software Melbourne crew. :)

IRONY: Initially I committed this as "media manager".
 2013-08-16 15:30:16 -07:00
Christopher Allan Webber
77ea4c9bd1 Updating to the point where we can allllmost run with the new reprocessing code 
This commit sponsored by Odin Hørthe Omdal.  Thank you!
 2013-08-16 15:30:16 -07:00
Christopher Allan Webber
d1e9913b71 Should be enough to get to the point where you can actually initialize a processing command now. 
However, it doesn't celery task-ify it...

This commit sponsored by Catalin Cosovanu.  Thank you!
 2013-08-16 15:30:16 -07:00
Christopher Allan Webber
4ba5bdd96e Steps toward working "run" reprocessing command. 
This commit sponsored by Philippe Casteleyn.  Thank you!
 2013-08-16 15:30:16 -07:00
Christopher Allan Webber
55a10fef0a gmg reprocess available --action-help now tells you processor arguments! 
Every reprocessing action possible can inform you of its command line
argument stuff!  Is that awesome or what?
 2013-08-16 15:30:15 -07:00
Christopher Allan Webber
85ead8ac3c "initial" reprocessing subcommand now works! 
We are on our way now to a working reprocessing system under this
redesign!

This commit sponsored by Bjarni Rúnar Einarsson.  Thank you!
 2013-08-16 15:30:15 -07:00
Christopher Allan Webber
e4bdc9091c More steps towards a working reprocessing system. 
Fleshing out the base classes and setting up some docstrings.  Not
everything is totally clear yet, but I think it's on a good track, and
getting clearer.

This commit sponsored by Ben Finney, on behalf of Free Software Melbourne.
Thank you all!
 2013-08-16 15:30:15 -07:00
Christopher Allan Webber
274a0f67fd Documentation for the MediaProcessor 2013-08-16 15:30:15 -07:00
Christopher Allan Webber
14565fb720 started coding basics of new processing code 2013-08-16 15:30:15 -07:00
Rodney Ewing
c541fb71f7 fix storage paramater in get_orig_filename(), fix __init__ for ProceessImage, better description for --size flag 2013-08-16 15:30:15 -07:00
Rodney Ewing
45b20dce1a change get_queued_filename to get_orig_filename and modified function 2013-08-16 15:30:14 -07:00
Rodney Ewing
49db778579 very rough working version of image reprocessing 2013-08-16 15:30:14 -07:00
Rodney Ewing
9a2c66ca9e added image reprocessing 2013-08-16 15:30:14 -07:00
Aditi
2392fbc02b Typo error. 2013-07-03 08:22:48 +05:30
Elrond
e6bd03d429 Doc string for ProcessingState. 2013-04-22 22:18:24 +02:00
Elrond
8ec87dc3fd Implement queue dir delete for proc_state.delete_queue_file 
Implement queue dir deleting in the
proc_state.delete_queue_file helper function.
 2013-04-08 16:12:32 +02:00
Elrond
d9f61cf7d7 Create ProcessingState.store_public. 
The ideas is by Alon Levy.

Use it in ProcessingState.copy_original for now.
 2013-04-03 18:52:17 +02:00
Elrond
fb46fa663d Kill monkeypatching of ProcessingState. 
And change the process_foo() API to accept a
processingstate now.

image and video are tested, the others are UNTESTED.
 2013-02-08 10:09:37 +01:00
Elrond
715ea49546 Also refactor "copy original into public storage". 
This makes the processing code easier to read/write and
alos will help the reprocessing once we get to it.

Thanks to Joar Wandborg for testing!
 2013-02-08 10:09:37 +01:00
Elrond
e382792637 ProcessingState: Document monkey patching. 2013-02-08 10:09:37 +01:00
Elrond
93b14fc300 Implement ProcessingState class and use for images 
The idea is to have a class that has the knowledge of the
currently being processed media and also has tools for
that.

The long term idea is to make reprocessing easier by for
example hiding the way the original comes into the
processing code.
 2013-02-08 10:05:42 +01:00