You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 00:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Jul 19, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1337399280,0cyclictest0-21swapper/311:22:373
13373992623,3cyclictest0-21swapper/311:50:223
1337399260,25cyclictest0-21swapper/312:18:083
1337399260,25cyclictest0-21swapper/310:42:553
1337399260,21cyclictest9760-21switchtime11:07:433
1337399260,0cyclictest0-21swapper/310:34:563
13373992523,2cyclictest0-21swapper/311:31:513
13373992522,3cyclictest7895-21diskmemload09:34:523
13373992520,4cyclictest7895-21diskmemload10:24:313
13373992520,4cyclictest7895-21diskmemload09:57:513
1337399250,24cyclictest1969-21ssh12:27:443
1337399250,24cyclictest0-21swapper/310:02:433
1337399250,24cyclictest0-21swapper/309:13:253
1337399250,1cyclictest3443-21sh09:35:073
1336599250,2cyclictest8261-21ssh12:05:112
1336299250,24cyclictest7895-21diskmemload11:18:481
1336299250,24cyclictest21256-21ssh10:20:511
1336299250,24cyclictest16623-21ssh09:17:391
1336299250,24cyclictest0-21swapper/110:00:251
13359992523,1cyclictest6045-21ssh10:36:140
1335999250,24cyclictest20511-21sh12:16:100
13373992420,3cyclictest0-21swapper/310:50:383
13373992420,3cyclictest0-21swapper/310:48:533
13373992419,4cyclictest7895-21diskmemload10:57:593
1337399240,24cyclictest0-21swapper/309:43:183
1337399240,23cyclictest7895-21diskmemload11:36:063
1337399240,23cyclictest7895-21diskmemload11:25:203
1337399240,20cyclictest7895-21diskmemload11:45:463
1337399240,20cyclictest0-21swapper/310:07:373
1337399240,1cyclictest7895-21diskmemload11:41:133
1337399240,0cyclictest7895-21diskmemload12:23:133
1337399240,0cyclictest7895-21diskmemload10:10:293
1337399240,0cyclictest7895-21diskmemload09:48:243
1337399240,0cyclictest0-21swapper/312:09:273
1337399240,0cyclictest0-21swapper/311:03:013
1337399240,0cyclictest0-21swapper/311:03:013
1336599240,23cyclictest7895-21diskmemload12:13:412
1336599240,23cyclictest1439-21sh10:32:232
1336599240,23cyclictest0-21swapper/210:02:582
1336599240,23cyclictest0-21swapper/209:21:552
13362992423,1cyclictest7895-21diskmemload11:07:301
13362992422,1cyclictest12026-21processes09:42:401
1336299240,24cyclictest7895-21diskmemload12:33:421
1336299240,24cyclictest7895-21diskmemload09:38:481
1336299240,24cyclictest0-21swapper/112:09:301
1336299240,24cyclictest0-21swapper/111:29:161
1336299240,23cyclictest29080-21apt-get10:57:341
1336299240,23cyclictest0-21swapper/112:11:471
1336299240,0cyclictest0-21swapper/111:59:281
13359992424,0cyclictest0-21swapper/011:06:290
13359992421,2cyclictest696-21awk08:55:010
1335999240,2cyclictest17261-21ssh12:12:410
1335999240,24cyclictest7895-21diskmemload11:37:410
1335999240,24cyclictest7895-21diskmemload10:21:390
1335999240,23cyclictest0-21swapper/009:52:390
1335999240,1cyclictest28735-21ssh11:54:380
1335999240,0cyclictest0-21swapper/010:18:350
1335999240,0cyclictest0-21swapper/010:18:350
13373992323,0cyclictest7895-21diskmemload12:12:493
13373992321,1cyclictest19756-21ssh09:20:443
13373992320,3cyclictest0-21swapper/310:36:533
13373992319,3cyclictest0-21swapper/310:15:513
13373992319,3cyclictest0-21swapper/310:15:513
1337399230,23cyclictest0-21swapper/311:17:513
1337399230,23cyclictest0-21swapper/309:26:313
1337399230,22cyclictest24579-21sh09:54:103
1337399230,0cyclictest7895-21diskmemload12:03:253
13365992323,0cyclictest0-21swapper/212:01:142
13365992323,0cyclictest0-21swapper/211:47:112
13365992323,0cyclictest0-21swapper/211:12:542
13365992323,0cyclictest0-21swapper/210:51:162
13365992323,0cyclictest0-21swapper/210:11:372
13365992323,0cyclictest0-21swapper/209:59:282
13365992321,1cyclictest4330-21ssh10:05:152
13365992321,1cyclictest0-21swapper/212:22:382
13365992321,0cyclictest0-21swapper/210:20:502
13365992320,2cyclictest30577-21ssh11:56:442
13365992320,2cyclictest27942-21ssh10:56:012
13365992320,2cyclictest25418-21ssh11:52:192
13365992319,4cyclictest0-21swapper/211:15:252
13365992318,4cyclictest0-21swapper/211:02:462
13365992318,4cyclictest0-21swapper/211:02:462
1336599230,23cyclictest0-21swapper/211:35:052
1336599230,23cyclictest0-21swapper/210:43:042
1336599230,22cyclictest9850-21ssh12:35:252
1336599230,22cyclictest7895-21diskmemload12:26:092
1336599230,22cyclictest7895-21diskmemload12:19:182
1336599230,22cyclictest4569-21sh12:30:402
1336599230,22cyclictest25240-21munin-run09:55:002
1336599230,22cyclictest1873-21ssh11:30:212
1336599230,22cyclictest0-21swapper/210:16:022
1336599230,22cyclictest0-21swapper/210:16:022
1336599230,22cyclictest0-21swapper/209:40:572
13362992323,0cyclictest0-21swapper/112:37:101
13362992323,0cyclictest0-21swapper/112:24:011
13362992323,0cyclictest0-21swapper/111:14:331
13362992323,0cyclictest0-21swapper/110:54:511
13362992323,0cyclictest0-21swapper/110:31:421
13362992323,0cyclictest0-21swapper/110:25:391
13362992323,0cyclictest0-21swapper/110:08:031
13362992321,2cyclictest12688-21sh10:12:411
13362992321,1cyclictest15862-21grep08:20:001
13362992321,1cyclictest0-21swapper/111:22:211
13362992321,1cyclictest0-21swapper/111:00:021
13362992321,1cyclictest0-21swapper/111:00:021
13362992320,2cyclictest16919-21ssh10:46:021
13362992320,2cyclictest13464-21apt08:15:011
1336299230,23cyclictest0-21swapper/112:17:071
1336299230,22cyclictest5405-21diskmemload10:35:131
1336299230,22cyclictest2870-21sh12:00:221
1336299230,22cyclictest25940-21sh09:26:441
1336299230,22cyclictest20453-21cstates11:47:361
1336299230,1cyclictest6094-21ssh11:33:511
1336299230,0cyclictest0-21swapper/111:37:181
1335999232,21cyclictest62550irq/127-eno112:05:270
13359992321,1cyclictest0-21swapper/012:28:120
13359992321,1cyclictest0-21swapper/010:10:530
13359992320,2cyclictest9295-21ssh09:40:250
13359992317,2cyclictest2197-21grep10:02:430
1335999230,22cyclictest31877-21idleruntime-cro10:30:010
1335999230,22cyclictest3117-21perf09:00:010
1335999230,22cyclictest31079-21sh11:57:220
1335999230,22cyclictest22590-21ssh10:51:170
1335999230,22cyclictest18027-21ssh11:15:490
1335999230,22cyclictest17862-21ssh11:44:560
1335999230,21cyclictest7895-21diskmemload11:00:020
1335999230,21cyclictest7895-21diskmemload11:00:020
1335999230,1cyclictest0-21swapper/011:45:360
1335999230,0cyclictest7895-21diskmemload12:23:350
1335999230,0cyclictest7895-21diskmemload10:59:280
1335999230,0cyclictest0-21swapper/010:33:300
1335999230,0cyclictest0-21swapper/009:29:440
13373992222,0cyclictest0-21swapper/311:10:053
13373992220,2cyclictest0-21swapper/311:55:323
13373992219,2cyclictest7895-21diskmemload12:35:093
1337399220,21cyclictest1911-21apt-get07:52:343
1337399220,21cyclictest0-21swapper/310:25:203
13365992222,0cyclictest0-21swapper/211:06:302
13365992222,0cyclictest0-21swapper/210:45:112
13365992220,1cyclictest15722-21sh09:46:522
13365992220,1cyclictest0-21swapper/209:30:412
13365992220,0cyclictest0-21swapper/211:25:222
1336599220,21cyclictest7895-21diskmemload10:25:032
1336599220,21cyclictest26336-21apt-get08:42:352
1336599220,21cyclictest13078-21ssh11:40:382
1336599220,21cyclictest0-21swapper/211:20:372
1336599220,21cyclictest0-21swapper/210:35:072
1336599220,21cyclictest0-21swapper/209:35:392
1336599220,1cyclictest671-21latency_hist08:55:012
1336599220,1cyclictest0-21swapper/209:11:012
13362992222,0cyclictest7895-21diskmemload09:10:511
13362992222,0cyclictest0-21swapper/111:53:441
13362992222,0cyclictest0-21swapper/110:19:361
13362992222,0cyclictest0-21swapper/110:19:361
13362992222,0cyclictest0-21swapper/109:50:331
13362992221,1cyclictest7895-21diskmemload11:40:141
13362992221,0cyclictest0-21swapper/107:37:341
13362992220,1cyclictest26122-21dpkg07:35:001
13362992220,1cyclictest0-21swapper/109:45:111
1336299220,21cyclictest7895-21diskmemload09:31:321
1336299220,21cyclictest0-21swapper/112:25:251
1336299220,21cyclictest0-21swapper/109:20:081
1336299220,1cyclictest11086-21ssh10:40:271
13359992221,1cyclictest7895-21diskmemload11:20:380
1335999220,22cyclictest7895-21diskmemload09:16:540
1335999220,22cyclictest6348-21rm12:02:550
1335999220,22cyclictest17491-21sh10:46:460
1335999220,21cyclictest28274-21latency_hist08:45:010
1335999220,21cyclictest0-21swapper/009:55:370
1335999220,21cyclictest0-21swapper/009:45:050
1335999220,21cyclictest0-21swapper/009:35:030
1335999220,21cyclictest0-21swapper/009:10:000
1335999220,21cyclictest0-21swapper/007:25:020
1335999220,1cyclictest18537-21sendmail-msp07:20:010
1335999220,1cyclictest0-21swapper/009:20:150
1335999220,0cyclictest0-21swapper/012:36:350
1335999220,0cyclictest0-21swapper/010:40:350
1335999220,0cyclictest0-21swapper/009:10:010
1337399210,20cyclictest0-21swapper/308:27:353
1337399210,1cyclictest0-21swapper/307:45:003
13365992121,0cyclictest7895-21diskmemload09:15:282
13365992121,0cyclictest0-21swapper/207:25:022
13365992120,1cyclictest19127-21apt-get08:27:352
13365992120,0cyclictest11513-21apt-get08:12:342
13365992119,1cyclictest1437-21cron07:50:002
1336599210,0cyclictest7895-21diskmemload09:25:262
13362992120,1cyclictest1151-21apt-get08:57:351
13362992119,1cyclictest0-21swapper/107:20:011
1336299210,0cyclictest0-21swapper/108:27:351
13359992120,1cyclictest30649-21sh09:30:300
13359992119,1cyclictest5522-21perf09:05:010
1335999210,21cyclictest0-21swapper/012:30:080
1335999210,21cyclictest0-21swapper/011:10:320
1335999210,20cyclictest0-21swapper/007:47:350
1335999210,20cyclictest0-21swapper/007:22:350
1335999210,1cyclictest15840-21cron08:20:000
1335999210,0cyclictest0-21swapper/011:25:240
1335999210,0cyclictest0-21swapper/008:07:350
13373992020,0cyclictest0-21swapper/308:57:353
13373992019,0cyclictest13771-21apt-get07:12:343
13373992018,1cyclictest6724-21apt-get08:02:333
13365992020,0cyclictest24175-21apt-get07:32:352
13365992020,0cyclictest0-21swapper/209:07:342
13365992018,1cyclictest16565-21apt-get07:17:342
13362992020,0cyclictest0-21swapper/107:57:351
13362992020,0cyclictest0-21swapper/107:25:021
13362992020,0cyclictest0-21swapper/107:22:341
13362992018,1cyclictest30721-21apt08:50:011
13359992020,0cyclictest0-21swapper/007:12:340
13359992018,1cyclictest13479-21munin-run08:15:010
1335999200,0cyclictest0-21swapper/007:52:330
1335999200,0cyclictest0-21swapper/007:37:340
13373991919,0cyclictest0-21swapper/309:07:343
13373991919,0cyclictest0-21swapper/308:42:343
13373991919,0cyclictest0-21swapper/308:37:333
13373991919,0cyclictest0-21swapper/307:17:343
13373991917,1cyclictest5491-21cron09:05:013
13373991917,1cyclictest26107-21apt-get07:35:023
13365991919,0cyclictest0-21swapper/208:32:342
1336599190,0cyclictest23917-21apt-get08:37:332
13362991919,0cyclictest0-21swapper/108:20:011
13362991918,0cyclictest31175-21apt-get08:52:321
13362991917,1cyclictest9119-21apt-get08:07:351
13359991917,1cyclictest6243-21apt08:00:010
13359991917,1cyclictest24175-21apt-get07:32:350
1335999190,0cyclictest0-21swapper/008:32:340
13373991818,0cyclictest0-21swapper/307:32:353
13373991817,0cyclictest4307-21apt-get07:57:343
13365991818,0cyclictest0-21swapper/207:57:352
13365991818,0cyclictest0-21swapper/207:42:342
1336599180,0cyclictest0-21swapper/207:35:022
13362991818,0cyclictest0-21swapper/108:37:331
13362991816,1cyclictest0-21swapper/108:42:341
1336299180,17cyclictest15943-21apt-key07:15:011
13373991715,1cyclictest11063-21dump-pmu-power08:10:013
13373991714,1cyclictest0-21swapper/308:17:323
1337399170,16cyclictest0-21swapper/307:46:493
13365991717,0cyclictest0-21swapper/208:07:352
13365991716,0cyclictest16731-21apt-get08:22:332
13362991717,0cyclictest0-21swapper/107:47:351
13362991716,1cyclictest5510-21awk09:05:011
13359991717,0cyclictest0-21swapper/008:20:020
1335999170,17cyclictest0-21swapper/007:42:430
13373991616,0cyclictest0-21swapper/308:22:333
13373991613,2cyclictest19169-21expr07:22:353
1337399160,15cyclictest0-21swapper/308:12:443
13365991616,0cyclictest0-21swapper/207:12:342
13365991615,0cyclictest0-21swapper/207:22:352
1336599160,0cyclictest0-21swapper/208:57:362
13362991614,1cyclictest606-21dbus-daemon08:35:001
13359991616,0cyclictest0-21swapper/008:37:330
13359991614,1cyclictest19127-21apt-get08:27:350
1337399150,0cyclictest0-21swapper/308:54:333
13365991515,0cyclictest28729-21apt-get08:47:342
1336599150,1cyclictest15334-21sed08:17:412
1336299150,14cyclictest1911-21apt-get07:52:341
13373991414,0cyclictest0-21swapper/308:45:043
1337399140,14cyclictest0-21swapper/308:30:493
1337399140,14cyclictest0-21swapper/307:25:153
13365991414,0cyclictest0-21swapper/208:00:332
13365991414,0cyclictest0-21swapper/207:50:352
1336599140,14cyclictest0-21swapper/209:00:292
1336299140,14cyclictest0-21swapper/109:05:201
1336299140,14cyclictest0-21swapper/107:40:161
13359991414,0cyclictest0-21swapper/008:45:400
1335999140,0cyclictest0-21swapper/008:00:410
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional