Somewhat limiting....

Message boards : Number crunching : Somewhat limiting....
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
adrianxw

Send message
Joined: 31 Oct 21
Posts: 6
Credit: 0
RAC: 0
Message 5 - Posted: 31 Oct 2021, 16:13:08 UTC
Last modified: 31 Oct 2021, 16:14:09 UTC

Somewhat limiting....

>>> This project doesn't support computers of type windows_x86_64
ID: 5 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Contact
Avatar

Send message
Joined: 31 Oct 21
Posts: 6
Credit: 69,390
RAC: 0
Message 7 - Posted: 31 Oct 2021, 16:36:25 UTC - in response to Message 5.  

I got the same message with linux. Likely because there are no apps for this project yet.
https://comp.ithena.net/usr/apps.php
ID: 7 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rysiu
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 29 Oct 21
Posts: 59
Credit: 10,300
RAC: 0
Message 8 - Posted: 31 Oct 2021, 16:52:06 UTC

Exactly right.
The app is not yet added ;)
ID: 8 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Werinbert

Send message
Joined: 31 Oct 21
Posts: 1
Credit: 100,272
RAC: 0
Message 10 - Posted: 31 Oct 2021, 16:55:28 UTC
Last modified: 31 Oct 2021, 16:56:05 UTC

It is all a Halloween trick ;)

How soon can we expect the treats?
ID: 10 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rysiu
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 29 Oct 21
Posts: 59
Credit: 10,300
RAC: 0
Message 11 - Posted: 31 Oct 2021, 17:04:40 UTC

This is not just a joke :)
The Haloowen date is a total coincidence.
I have been planning to add compute (CPU) tasks for a very long time.
We plan to add the first test graph application soon (depending on how fast it passes initial testing).
ID: 11 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Sphynx

Send message
Joined: 1 Nov 21
Posts: 5
Credit: 1,744,040
RAC: 0
Message 17 - Posted: 1 Nov 2021, 11:12:57 UTC
Last modified: 1 Nov 2021, 11:15:44 UTC

Getting work now, but all are ending in computational errors after about 4min 20 sec.

<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 248.95 (1440.00G/5.78G)</message>
<stderr_txt>
07:00:22 (343108): wrapper (7.5.26014): starting
07:00:22 (343108): wrapper: running ithena_graph_v1.02_x86_64-pc-linux-gnu (--silent)

</stderr_txt>
]]>
ID: 17 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rysiu
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 29 Oct 21
Posts: 59
Credit: 10,300
RAC: 0
Message 18 - Posted: 1 Nov 2021, 11:19:32 UTC

I have corrected this bug in the next versions of the tasks.
We are waiting for confirmation...
ID: 18 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rysiu
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 29 Oct 21
Posts: 59
Credit: 10,300
RAC: 0
Message 22 - Posted: 1 Nov 2021, 13:12:04 UTC

If possible, please let me know how long the iThena GRAPH tasks currently count with you?
How much time do you have in current tasks already (in progress on client)?
ID: 22 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Sphynx

Send message
Joined: 1 Nov 21
Posts: 5
Credit: 1,744,040
RAC: 0
Message 23 - Posted: 1 Nov 2021, 13:12:18 UTC - in response to Message 18.  

I have corrected this bug in the next versions of the tasks.
We are waiting for confirmation...

All are running past the 4min 20sec mark now. Now to see if they finish and validate.
ID: 23 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rysiu
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 29 Oct 21
Posts: 59
Credit: 10,300
RAC: 0
Message 24 - Posted: 1 Nov 2021, 13:24:56 UTC - in response to Message 23.  

All are running past the 4min 20sec mark now. Now to see if they finish and validate.

So we wait.
If you can you report the information :)
ID: 24 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rysiu
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 29 Oct 21
Posts: 59
Credit: 10,300
RAC: 0
Message 25 - Posted: 1 Nov 2021, 13:33:54 UTC

ID: 25 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PDW

Send message
Joined: 31 Oct 21
Posts: 8
Credit: 10,745,800
RAC: 569
Message 26 - Posted: 1 Nov 2021, 13:36:00 UTC - in response to Message 24.  

After 2 hours and 28 minutes still exceeding the time limit on a v1.02...

<core_client_version>7.17.0</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 8896.48 (54400.00G/6.11G)</message>
<stderr_txt>
10:56:03 (3632738): wrapper (7.5.26014): starting
10:56:03 (3632738): wrapper: running ithena_graph_v1.02_x86_64-pc-linux-gnu (--silent)

</stderr_txt>
]]>


Is there a reason you can't set it high and then reduce that figure once you've worked out how long they should actually run for ?
ID: 26 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Fardringle

Send message
Joined: 31 Oct 21
Posts: 10
Credit: 3,543,120
RAC: 92
Message 27 - Posted: 1 Nov 2021, 14:36:47 UTC - in response to Message 26.  
Last modified: 1 Nov 2021, 14:50:37 UTC

Agreed. It seems that these tasks have a very wide range of run times depending on the computer, and your estimate and max run time limit are too low.

Tasks running on my Xeon E5-1650 v4 are estimating run times of around 3.3 - 3.5 hours. And tasks running on my Ryzen 9 3900X are estimating run times of more than 5 hours. Both of these computers are normally a lot faster than the Xeon E3 1220 test machine mentioned in the announcement message, but are not running the .Computational tasks that fast and need to have more time allowed to finish the tasks.

Also, these tasks are actually using more than one CPU thread per task. On the E5-1650 with 6 cores/12 threads I had to reduce the number of running tasks down to 8 before the total CPU usage dropped below 100%. On the 3900X with 12 cores/24 threads, I had to drop it down to 18 running tasks to get the total CPU usage below 100%.

If the tasks were actually just using one CPU thread each, the totals would have dropped below 100% at 11 tasks on the E5-1650 and 23 tasks on the 3900X...

This might explain the higher run times than the original estimate as well. For those of us who usually run a number of tasks equal to the number of CPU threads, the tasks aren't getting the amount of CPU time that they want.
ID: 27 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Sphynx

Send message
Joined: 1 Nov 21
Posts: 5
Credit: 1,744,040
RAC: 0
Message 28 - Posted: 1 Nov 2021, 14:55:19 UTC

Agreed, they run longer, but still error out.

<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 11031.19 (54400.00G/4.93G)</message>
<stderr_txt>
07:35:32 (482679): wrapper (7.5.26014): starting
07:35:32 (482679): wrapper: running ithena_graph_v1.02_x86_64-pc-linux-gnu (--silent)

</stderr_txt>
]]>
ID: 28 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Fardringle

Send message
Joined: 31 Oct 21
Posts: 10
Credit: 3,543,120
RAC: 92
Message 29 - Posted: 1 Nov 2021, 14:56:32 UTC - in response to Message 27.  

On a side note, based on the task in the link in the "First Success" post made earlier, I realize that this is still the basic testing stage, but if you want people to continue to participate in the new CPU intensive project, you need to give a LOT more than 8 credits for CPU tasks that take several hours to complete!
ID: 29 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rysiu
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 29 Oct 21
Posts: 59
Credit: 10,300
RAC: 0
Message 30 - Posted: 1 Nov 2021, 15:58:40 UTC

I've noticed problems.
I increased 10x the possible execution time.
I set it to 40 credits per WU at this moment.
There is a new specification for tasks in the new series "TESTS_1A_T..."
ID: 30 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Michael Goetz
Avatar

Send message
Joined: 1 Nov 21
Posts: 5
Credit: 19,104
RAC: 0
Message 32 - Posted: 1 Nov 2021, 16:23:00 UTC - in response to Message 25.  

First "Success":
https://comp.ithena.net/usr/workunit.php?wuid=5321 :)



Cool, that one's mine. For reference, it's a real Linux machine, not a VM. It's a Haswell-class Intel i5.

I set up everything linuxy last night to automatically grab tasks here when they became available. That may lead to some problems with timeouts., since there's now multiple VMs plus host systems overcommitting cpu cores. I've paired it back a bit.

One of the systems running tasks is an *old* laptop. Really slow. We'll see how long it takes.

If I'm setting time limits on tasks, I generally look at the slowest active computer in the database, figure out how long it should take to run a task, and multiply *that* by 10. There's all sorts of reasons why tasks will run slower than 'normal',
Want to find one of the largest known primes? Try PrimeGrid. Or help cure disease at WCG.

ID: 32 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Michael Goetz
Avatar

Send message
Joined: 1 Nov 21
Posts: 5
Credit: 19,104
RAC: 0
Message 33 - Posted: 1 Nov 2021, 16:31:29 UTC - in response to Message 30.  

I've noticed problems.
I increased 10x the possible execution time.
I set it to 40 credits per WU at this moment.
There is a new specification for tasks in the new series "TESTS_1A_T..."


Looks like my slow machine is going to need about 8 to 10 hours per task. That's a 1st gen i3 (2c/4t) laptop, with your tasks run on two threads and some heavy computational stuff (prime95-ish) on the other 2 threads.
Want to find one of the largest known primes? Try PrimeGrid. Or help cure disease at WCG.

ID: 33 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rysiu
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 29 Oct 21
Posts: 59
Credit: 10,300
RAC: 0
Message 34 - Posted: 1 Nov 2021, 16:32:31 UTC

On an Intel Xeon E3 1220 @ 3.10GHz processor the computation time should be ~177 minutes.

This time Xeon E3 1220 was actually on 1 core and at a time when the other 3 cores were in idle.
In fact if I had run the x4 application (all core) it could have been quite a bit slower.
ID: 34 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
fzs600

Send message
Joined: 1 Nov 21
Posts: 3
Credit: 1,276,358
RAC: 180
Message 35 - Posted: 1 Nov 2021, 16:34:59 UTC - in response to Message 32.  

hello
on one of my PCs
Intel(R) Core(TM) i7 CPU 870 @ 2.93GHz [Family 6 Model 30 Stepping 5]
(8 processors)
computer 94
I received 152 WU at the same time, is this normal?
thank you
ID: 35 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · 3 · Next

Message boards : Number crunching : Somewhat limiting....

© 2019-2024 iThena. All rights reserved. | Private Policy

Page generated on 19 May 2024, 19:39:28 UTC in 0.475 seconds.