You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-21 - 08:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6s.osadl.org (updated Fri Mar 21, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3563912998857,17cyclictest0-21swapper/220:55:012
356390899621,54cyclictest0-21swapper/020:00:120
3563909995836,16cyclictest231ktimers/122:50:091
3563908995650,4cyclictest3568541-21gpgconf19:35:020
3563909995532,20cyclictest231ktimers/100:25:011
356390899547,12cyclictest19950irq/27-20000000.i2c19:45:010
356390899538,13cyclictest0-21swapper/023:15:010
356390899537,5cyclictest0-21swapper/023:20:020
3563908995345,5cyclictest3566703-21munin-plugin-st19:25:000
3563909995233,9cyclictest231ktimers/120:50:011
3563909995011,34cyclictest22-21rcuc/119:30:211
3563909994932,12cyclictest0-21swapper/122:04:591
3563909994931,12cyclictest231ktimers/121:10:071
3563908994924,3cyclictest3603973-21apt-get23:35:130
356390899491,44cyclictest3577465-21fschecks_count20:30:210
3563912994837,6cyclictest0-21swapper/220:50:322
3563909994834,10cyclictest0-21swapper/100:15:241
3563909994810,13cyclictest22-21rcuc/122:40:011
3563912994737,7cyclictest3578101-21apt-key20:35:012
3563912994735,8cyclictest0-21swapper/221:30:432
3563912994735,8cyclictest0-21swapper/221:30:422
3563909994730,10cyclictest0-21swapper/123:35:231
3563908994739,3cyclictest168250irq/119-8000000.ethernet-tx020:20:180
3563908994735,6cyclictest3589678-21grep21:50:330
3563912994633,9cyclictest0-21swapper/223:30:022
3563912994623,11cyclictest3563903-21cyclictest22:55:022
3563909994639,3cyclictest3590600-21sendmail22:00:001
3563909994639,3cyclictest3590600-21sendmail22:00:001
3563909994635,6cyclictest3600075-21munin-plugin-st23:09:591
3563909994635,5cyclictest3569309-21latency_hist19:39:591
3563909994631,8cyclictest3593370-21sendmail22:20:001
3563909994615,5cyclictest3598842-21tr22:55:301
3563912994537,4cyclictest0-21swapper/221:10:002
3563912994519,15cyclictest30-21rcuc/222:50:012
3563912994432,8cyclictest0-21swapper/220:05:292
3563909994432,8cyclictest3575459-21sendmail20:19:591
3563909994429,8cyclictest0-21swapper/122:30:231
3563912994337,3cyclictest47-21kauditd23:55:002
3563912994331,7cyclictest0-21swapper/220:10:332
356390899435,34cyclictest0-21swapper/021:15:310
356390899435,34cyclictest0-21swapper/021:15:300
3563908994335,4cyclictest20750irq/251-8000000.ethernet20:50:230
3563912994235,3cyclictest168450irq/135-8000000.ethernet-tx222:35:142
3563912994234,4cyclictest0-21swapper/221:40:292
3563912994232,7cyclictest3585883-21grep21:20:322
3563912994232,6cyclictest0-21swapper/200:15:332
3563912994230,7cyclictest0-21swapper/222:10:252
3563912994230,7cyclictest0-21swapper/222:10:242
3563912994229,9cyclictest0-21swapper/200:10:252
3563909994229,9cyclictest0-21swapper/123:30:001
3563909994227,9cyclictest0-21swapper/120:05:291
3563908994231,8cyclictest0-21swapper/022:20:010
3563908994228,12cyclictest14-21rcu_preempt20:15:020
3563908994221,18cyclictest0-21swapper/000:00:200
3563912994124,9cyclictest0-21swapper/223:40:292
3563909994124,10cyclictest231ktimers/121:15:161
3563909994124,10cyclictest231ktimers/121:15:161
3563909994114,13cyclictest231ktimers/120:30:121
3563908994118,18cyclictest0-21swapper/023:00:260
3563908994118,18cyclictest0-21swapper/023:00:260
3563912994033,4cyclictest30-21rcuc/219:30:212
3563912994028,7cyclictest0-21swapper/221:10:242
3563912994016,6cyclictest27350irq/343-s-wl18xx22:00:022
3563912994016,6cyclictest27350irq/343-s-wl18xx22:00:012
3563909994032,4cyclictest0-21swapper/122:20:321
3563909994032,4cyclictest0-21swapper/122:20:311
3563909994030,5cyclictest0-21swapper/121:50:321
3563909994028,7cyclictest3592408-21grep22:10:251
3563909994028,7cyclictest3592408-21grep22:10:251
3563909994020,12cyclictest231ktimers/119:20:121
3563908994034,4cyclictest20950irq/209-8000000.ethernet23:45:020
3563908994030,6cyclictest3609229-21grep00:10:240
3563908994026,8cyclictest0-21swapper/021:10:010
3563908994012,5cyclictest3590807-21latency_hist22:00:010
3563912993929,7cyclictest3565852-21sendmail19:20:002
3563912993929,7cyclictest3565852-21sendmail19:20:002
3563912993928,7cyclictest3604501-21grep23:35:302
3563912993928,5cyclictest0-21swapper/220:40:302
3563912993926,8cyclictest0-21swapper/222:55:302
3563912993925,8cyclictest3571991-21grep19:55:302
3563912993925,8cyclictest3571991-21grep19:55:292
3563909993931,4cyclictest0-21swapper/121:20:311
3563909993925,8cyclictest0-21swapper/123:10:241
3563909993921,11cyclictest0-21swapper/119:30:001
356390999391,2cyclictest0-21swapper/119:55:011
3563908993932,4cyclictest20950irq/209-8000000.ethernet21:50:020
3563908993931,5cyclictest131ktimers/023:30:050
3563908993925,9cyclictest0-21swapper/000:35:200
3563912993826,7cyclictest0-21swapper/219:10:302
3563912993824,8cyclictest0-21swapper/219:25:302
3563912993822,9cyclictest0-21swapper/223:00:312
3563912993822,9cyclictest0-21swapper/223:00:312
356391299381,10cyclictest0-21swapper/220:45:022
3563909993825,7cyclictest0-21swapper/120:25:271
356390899384,4cyclictest0-21swapper/019:20:010
356390899384,4cyclictest0-21swapper/019:20:010
3563908993827,5cyclictest3591422-21grep22:00:300
356390899381,4cyclictest0-21swapper/019:40:010
356390899381,32cyclictest0-21swapper/021:55:110
356390899381,2cyclictest0-21swapper/019:30:020
3563912993725,8cyclictest3607306-21grep23:55:272
3563909993727,8cyclictest22-21rcuc/119:15:011
3563909993726,7cyclictest3586912-21grep21:30:441
3563909993726,7cyclictest3586912-21grep21:30:441
3563909993725,6cyclictest0-21swapper/122:40:001
3563909993723,7cyclictest0-21swapper/123:50:241
3563909993723,6cyclictest0-21swapper/123:20:281
356390899377,4cyclictest0-21swapper/000:30:000
3563908993732,3cyclictest0-21swapper/021:40:130
3563908993730,4cyclictest20750irq/251-8000000.ethernet23:55:170
3563908993729,5cyclictest131ktimers/021:35:300
3563908993726,8cyclictest3582307-21sendmail21:00:000
3563908993726,7cyclictest0-21swapper/022:10:240
3563908993726,7cyclictest0-21swapper/022:10:240
356390899372,10cyclictest3578818-21unixbench_multi20:35:280
356390899371,4cyclictest0-21swapper/000:20:000
3563912993624,8cyclictest0-21swapper/222:30:242
356391299361,29cyclictest0-21swapper/223:10:192
356391299361,29cyclictest0-21swapper/222:10:022
3563908993625,8cyclictest0-21swapper/022:44:590
3563908993624,9cyclictest0-21swapper/021:20:310
3563912993528,4cyclictest3576306-21cron20:25:002
3563912993526,5cyclictest0-21swapper/219:20:282
356391299351,27cyclictest0-21swapper/221:50:322
356390999351,2cyclictest0-21swapper/119:45:011
3563909993510,4cyclictest27250irq/343-wl18xx19:15:171
3563909993510,4cyclictest27250irq/343-wl18xx19:15:171
3563908993529,4cyclictest20950irq/209-8000000.ethernet19:10:140
3563908993528,4cyclictest20950irq/209-8000000.ethernet19:55:120
3563908993528,4cyclictest20950irq/209-8000000.ethernet19:55:120
3563908993528,4cyclictest0-21swapper/020:26:060
3563908993522,9cyclictest0-21swapper/022:55:300
3563908993516,17cyclictest0-21swapper/020:15:130
3563912993425,5cyclictest0-21swapper/222:00:312
3563912993421,8cyclictest0-21swapper/222:25:012
3563912993421,8cyclictest0-21swapper/222:25:012
3563909993424,4cyclictest0-21swapper/121:40:221
356390999341,3cyclictest0-21swapper/122:30:001
3563908993429,4cyclictest0-21swapper/019:50:080
3563908993427,5cyclictest131ktimers/022:30:250
356390899341,5cyclictest3579780-21munin-run20:45:000
356390899341,3cyclictest3583774-21fschecks_time21:10:180
356390899341,3cyclictest0-21swapper/000:20:200
3563908993411,12cyclictest3602840-21apt-get23:30:010
356391299336,16cyclictest0-21swapper/221:35:272
3563912993325,4cyclictest0-21swapper/223:20:002
3563912993325,4cyclictest0-21swapper/200:30:282
3563912993324,5cyclictest3602513-21grep23:20:282
3563912993318,7cyclictest0-21swapper/200:20:292
356391299331,27cyclictest0-21swapper/200:35:132
3563912993310,21cyclictest0-21swapper/220:15:172
3563909993326,4cyclictest3563903-21cyclictest20:35:201
3563909993326,4cyclictest0-21swapper/121:35:311
356390999332,3cyclictest0-21swapper/120:00:021
356390999332,3cyclictest0-21swapper/120:00:011
3563909993319,7cyclictest0-21swapper/121:00:311
3563909993313,13cyclictest231ktimers/120:50:181
3563908993327,4cyclictest20950irq/209-8000000.ethernet21:00:320
3563908993326,4cyclictest20750irq/251-8000000.ethernet00:30:170
3563908993323,6cyclictest3573674-21unixbench_multi20:05:300
356390899331,30cyclictest0-21swapper/023:50:240
3563912993225,4cyclictest168450irq/135-8000000.ethernet-tx221:15:262
3563912993225,4cyclictest168450irq/135-8000000.ethernet-tx221:15:252
3563912993219,7cyclictest0-21swapper/219:50:232
3563912993219,6cyclictest0-21swapper/200:00:222
356391299321,26cyclictest0-21swapper/221:00:252
3563909993223,6cyclictest3608659-21/usr/sbin/munin00:10:211
3563909993223,5cyclictest0-21swapper/100:35:311
3563909993221,6cyclictest3582184-21grep20:55:291
3563909993211,19cyclictest22-21rcuc/123:30:211
3563908993224,5cyclictest131ktimers/022:20:320
3563908993224,5cyclictest131ktimers/022:20:320
356390899321,3cyclictest0-21swapper/023:50:010
356390899321,29cyclictest0-21swapper/022:35:140
356390899321,19cyclictest0-21swapper/022:08:100
3563912993121,5cyclictest0-21swapper/219:40:282
3563912993120,5cyclictest0-21swapper/200:30:012
3563909993124,4cyclictest0-21swapper/120:20:181
3563909993122,6cyclictest0-21swapper/120:00:181
3563909993121,5cyclictest0-21swapper/100:00:011
356390999311,24cyclictest0-21swapper/119:47:051
3563908993127,2cyclictest0-21swapper/020:45:110
356390899311,18cyclictest0-21swapper/022:29:150
356390899311,18cyclictest0-21swapper/019:49:290
356390899311,18cyclictest0-21swapper/000:06:080
356391299309,4cyclictest27350irq/343-s-wl18xx23:45:042
356391299302,4cyclictest3589062-21date21:50:012
3563912993022,4cyclictest168450irq/135-8000000.ethernet-tx219:35:032
3563912993021,4cyclictest0-21swapper/222:15:212
3563912993016,7cyclictest0-21swapper/222:30:002
356391299301,24cyclictest0-21swapper/223:30:112
3563909993022,4cyclictest3597072-21kworker/u8:1-events_power_efficient23:00:301
3563909993022,4cyclictest3597072-21kworker/u8:1-events_power_efficient23:00:301
3563909993017,6cyclictest22-21rcuc/100:00:311
356390999301,23cyclictest0-21swapper/121:45:061
3563908993026,3cyclictest20950irq/209-8000000.ethernet21:30:240
3563908993026,3cyclictest20950irq/209-8000000.ethernet21:30:240
3563908993026,2cyclictest0-21swapper/023:20:200
356390899301,17cyclictest0-21swapper/023:07:190
356391299298,4cyclictest27350irq/343-s-wl18xx22:42:242
356391299291,4cyclictest3577988-21apt-get20:35:042
3563909992925,3cyclictest0-21swapper/120:40:261
3563909992920,6cyclictest0-21swapper/121:10:011
3563909992920,5cyclictest0-21swapper/123:20:011
3563909992917,8cyclictest3605435-21grep23:40:301
3563908992913,4cyclictest0-21swapper/021:28:240
356390899291,16cyclictest0-21swapper/022:51:260
356390899291,16cyclictest0-21swapper/022:45:380
356391299281,7cyclictest3572290-21/usr/sbin/munin20:00:262
3563912992817,7cyclictest3577056-21grep20:25:272
3563912992817,7cyclictest0-21swapper/219:50:022
3563909992821,4cyclictest3563903-21cyclictest00:30:211
3563909992819,6cyclictest1666-21snmpd23:47:071
3563909992817,5cyclictest0-21swapper/120:10:301
3563909992811,3cyclictest27350irq/343-s-wl18xx21:28:451
3563912992718,4cyclictest3562270-21kworker/u8:1-ext4-rsv-conversion19:10:022
356391299271,20cyclictest0-21swapper/221:25:222
3563909992714,5cyclictest0-21swapper/100:10:011
356391299261,14cyclictest0-21swapper/223:08:392
3563909992617,6cyclictest0-21swapper/122:50:021
356390999261,13cyclictest0-21swapper/122:08:501
356390999251,22cyclictest0-21swapper/100:28:351
356390999244,17cyclictest231ktimers/119:10:011
356390899241,21cyclictest0-21swapper/019:10:010
3563912992316,4cyclictest0-21swapper/200:05:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional