You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 22:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Jun 25, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2400899260,25cyclictest8017-21ssh09:58:552
24010992525,0cyclictest0-21swapper/309:45:183
2401099250,24cyclictest24896-21sleep11:40:003
2401099250,24cyclictest0-21swapper/312:35:163
2400899250,24cyclictest0-21swapper/209:37:512
2400399250,24cyclictest0-21swapper/112:01:071
23999992524,1cyclictest62550irq/127-eno110:44:300
23999992523,1cyclictest0-21swapper/009:40:130
2399999250,1cyclictest0-21swapper/010:15:050
24010992422,1cyclictest2977-21sh12:16:563
2401099242,1cyclictest5803-21sh12:20:353
2401099242,1cyclictest0-21swapper/310:00:003
2401099241,22cyclictest3782-21sh11:50:003
2401099240,23cyclictest0-21swapper/310:25:363
2401099240,23cyclictest0-21swapper/309:42:113
2401099240,23cyclictest0-21swapper/309:10:143
2401099240,1cyclictest0-21swapper/312:04:543
2401099240,0cyclictest17312-21diskmemload11:26:363
2401099240,0cyclictest0-21swapper/311:44:453
2400899240,23cyclictest0-21swapper/211:05:222
2400899240,0cyclictest17312-21diskmemload11:38:412
24003992424,0cyclictest17312-21diskmemload11:45:381
24003992424,0cyclictest17312-21diskmemload09:51:081
2400399240,24cyclictest0-21swapper/109:19:331
2400399240,23cyclictest0-21swapper/109:30:581
2400399240,0cyclictest17312-21diskmemload10:22:071
2400399240,0cyclictest0-21swapper/110:42:301
23999992423,1cyclictest0-21swapper/010:10:490
2399999240,24cyclictest0-21swapper/011:15:550
2399999240,24cyclictest0-21swapper/010:37:520
2399999240,23cyclictest17312-21diskmemload12:39:540
2399999240,23cyclictest17312-21diskmemload10:48:140
2399999240,23cyclictest0-21swapper/011:44:550
2399999240,23cyclictest0-21swapper/011:31:130
2399999240,0cyclictest17312-21diskmemload09:15:200
2399999240,0cyclictest0-21swapper/010:51:590
2399999240,0cyclictest0-21swapper/009:51:040
24010992323,0cyclictest0-21swapper/312:29:573
24010992323,0cyclictest0-21swapper/311:34:313
24010992323,0cyclictest0-21swapper/309:28:423
24010992321,1cyclictest0-21swapper/312:09:373
2401099230,23cyclictest0-21swapper/312:31:153
2401099230,23cyclictest0-21swapper/310:19:243
2401099230,23cyclictest0-21swapper/309:37:233
2401099230,22cyclictest7947-21sh11:53:003
2401099230,22cyclictest31966-21diskmemload09:21:593
2401099230,22cyclictest22003-21cron10:40:003
2401099230,22cyclictest0-21swapper/310:20:343
2401099230,1cyclictest0-21swapper/310:05:373
2401099230,0cyclictest17312-21diskmemload09:50:253
2401099230,0cyclictest0-21swapper/312:12:013
2401099230,0cyclictest0-21swapper/311:56:293
2401099230,0cyclictest0-21swapper/310:57:593
2401099230,0cyclictest0-21swapper/310:04:313
2401099230,0cyclictest0-21swapper/309:33:543
2401099230,0cyclictest0-21swapper/309:00:353
24008992323,0cyclictest0-21swapper/212:33:542
24008992323,0cyclictest0-21swapper/211:47:252
24008992323,0cyclictest0-21swapper/210:25:042
24008992323,0cyclictest0-21swapper/209:42:352
24008992322,1cyclictest30515-21ssh09:50:272
24008992322,1cyclictest25970-1kworker/u9:212:12:072
24008992322,1cyclictest13657-21ssh12:26:082
24008992321,1cyclictest29684-21diskmemload10:17:362
24008992320,1cyclictest0-21swapper/209:31:272
24008992319,3cyclictest0-21swapper/212:00:452
2400899230,2cyclictest17312-21diskmemload10:31:242
2400899230,23cyclictest17312-21diskmemload11:01:092
2400899230,23cyclictest17312-21diskmemload10:55:362
2400899230,23cyclictest0-21swapper/212:37:322
2400899230,23cyclictest0-21swapper/212:09:162
2400899230,23cyclictest0-21swapper/211:52:372
2400899230,23cyclictest0-21swapper/210:11:202
2400899230,22cyclictest17312-21diskmemload11:20:172
2400899230,22cyclictest0-21swapper/210:45:432
2400899230,22cyclictest0-21swapper/210:36:262
2400899230,1cyclictest17312-21diskmemload12:20:382
2400899230,1cyclictest12804-21sh11:28:582
2400899230,0cyclictest17312-21diskmemload09:22:362
2400899230,0cyclictest0-21swapper/210:06:022
2400899230,0cyclictest0-21swapper/209:13:232
24003992323,0cyclictest3166-21cstates11:20:361
24003992323,0cyclictest0-21swapper/111:25:361
24003992323,0cyclictest0-21swapper/110:47:081
24003992323,0cyclictest0-21swapper/109:27:271
24003992320,2cyclictest22235-21irqstats12:05:401
24003992320,2cyclictest16284-21sh09:36:491
2400399230,23cyclictest0-21swapper/112:30:031
2400399230,23cyclictest0-21swapper/112:13:501
2400399230,23cyclictest0-21swapper/111:12:041
2400399230,22cyclictest8743-21sendmail10:00:001
2400399230,22cyclictest32551-21idleruntime-cro08:35:001
2400399230,22cyclictest28443-21ssh10:15:551
2400399230,22cyclictest20417-21ssh10:10:071
2400399230,22cyclictest17312-21diskmemload09:20:031
2400399230,22cyclictest12759-21ssh10:02:471
2400399230,0cyclictest17312-21diskmemload09:45:091
2400399230,0cyclictest0-21swapper/112:24:251
2400399230,0cyclictest0-21swapper/111:50:351
2400399230,0cyclictest0-21swapper/111:40:041
23999992323,0cyclictest17312-21diskmemload09:10:010
23999992323,0cyclictest0-21swapper/012:30:250
23999992323,0cyclictest0-21swapper/012:00:170
23999992323,0cyclictest0-21swapper/009:30:300
23999992321,1cyclictest7325-21cron08:50:010
23999992321,1cyclictest0-21swapper/012:27:490
23999992321,1cyclictest0-21swapper/012:05:370
23999992321,1cyclictest0-21swapper/010:30:340
23999992321,1cyclictest0-21swapper/010:25:270
23999992321,1cyclictest0-21swapper/009:56:220
2399999230,2cyclictest9738-21dump-pmu-power08:55:010
2399999230,22cyclictest9391-21perf11:55:010
2399999230,22cyclictest6783-21kworker/u8:211:57:560
2399999230,22cyclictest17312-21diskmemload11:38:470
2399999230,22cyclictest15662-21dump-pmu-power08:00:010
2399999230,22cyclictest14870-21ssh10:05:170
2399999230,22cyclictest141rcuc/009:45:080
2399999230,22cyclictest0-21swapper/011:11:500
2399999230,22cyclictest0-21swapper/011:05:350
2399999230,22cyclictest0-21swapper/010:21:420
2399999230,22cyclictest0-21swapper/010:02:530
2399999230,22cyclictest0-21swapper/009:35:120
2399999230,1cyclictest0-21swapper/012:17:280
2399999230,1cyclictest0-21swapper/009:20:350
2399999230,0cyclictest0-21swapper/012:20:590
24010992222,0cyclictest0-21swapper/310:10:283
24010992221,0cyclictest0-21swapper/307:15:343
24010992220,1cyclictest12524-21sh09:00:013
24010992220,1cyclictest0-21swapper/310:50:373
2401099220,22cyclictest17312-21diskmemload11:05:183
2401099220,21cyclictest29677-21ssh11:15:313
2401099220,21cyclictest25354-21tr08:20:003
2401099220,21cyclictest15009-21ssh11:01:103
2401099220,21cyclictest0-21swapper/310:40:243
2401099220,21cyclictest0-21swapper/310:30:093
2401099220,21cyclictest0-21swapper/309:15:423
2401099220,1cyclictest17322-21cron09:10:003
2401099220,1cyclictest0-21swapper/310:46:353
24008992222,0cyclictest17312-21diskmemload11:11:062
24008992222,0cyclictest0-21swapper/212:16:182
24008992220,1cyclictest24685-21ssh09:45:142
24008992220,1cyclictest23377-21ssh09:15:212
24008992220,1cyclictest22938-21apt08:15:012
24008992220,1cyclictest0-21swapper/208:00:012
24008992219,2cyclictest12513-21idleruntime-cro09:00:012
2400899220,22cyclictest25606-21ssh10:42:142
2400899220,21cyclictest29553-21sh11:15:222
2400899220,21cyclictest14547-21cstates11:30:372
2400899220,21cyclictest0-21swapper/210:00:362
2400899220,1cyclictest4329-21ssh10:52:012
2400899220,1cyclictest25259-21sh11:40:112
2400899220,1cyclictest2399-21apt-get09:25:362
2400899220,1cyclictest0-21swapper/210:25:012
2400899220,0cyclictest17312-21diskmemload11:55:042
24003992222,0cyclictest0-21swapper/110:55:061
24003992221,1cyclictest18076-21sh11:05:041
24003992220,1cyclictest14830-21sh10:05:141
2400399220,22cyclictest17312-21diskmemload09:40:401
2400399220,22cyclictest0-21swapper/112:15:371
2400399220,22cyclictest0-21swapper/110:30:471
2400399220,21cyclictest8337-21ssh10:27:331
2400399220,21cyclictest21165-21ssh09:12:381
2400399220,21cyclictest0-21swapper/112:35:361
2400399220,21cyclictest0-21swapper/111:30:361
2400399220,21cyclictest0-21swapper/108:15:361
2400399220,1cyclictest31690-21ssh11:15:511
2400399220,1cyclictest22818-21sh11:37:151
2400399220,1cyclictest15516-21ssh12:28:441
2400399220,1cyclictest0-21swapper/110:50:381
2400399220,1cyclictest0-21swapper/107:40:001
23999992221,1cyclictest8192-21ssh10:55:410
23999992221,1cyclictest1463-21apt-get07:30:350
23999992220,1cyclictest8501-21grep07:45:000
23999992220,1cyclictest30149-21turbostat08:30:000
23999992220,1cyclictest0-21swapper/011:25:310
2399999220,21cyclictest17312-21diskmemload11:20:350
2399999220,21cyclictest0-21swapper/012:10:180
2399999220,21cyclictest0-21swapper/011:46:400
2399999220,21cyclictest0-21swapper/008:55:350
24010992120,1cyclictest0-21swapper/308:50:363
24010992119,1cyclictest0-21swapper/311:10:053
2401099210,20cyclictest0-21swapper/308:20:343
24008992118,2cyclictest7324-21basename08:50:012
2400899210,20cyclictest0-21swapper/207:40:362
2400899210,20cyclictest0-21swapper/207:20:352
2400899210,0cyclictest0-21swapper/208:50:352
2400399210,0cyclictest17312-21diskmemload10:35:221
2400399210,0cyclictest0-21swapper/107:30:351
23999992121,0cyclictest0-21swapper/009:00:350
23999992119,1cyclictest606-21dbus-daemon08:25:000
2399999210,1cyclictest13285-21grep07:55:010
24010992020,0cyclictest0-21swapper/307:40:363
24010992020,0cyclictest0-21swapper/307:35:333
2401099200,18cyclictest313-21systemd-journal07:25:013
24008992020,0cyclictest0-21swapper/208:40:362
24008992020,0cyclictest0-21swapper/208:35:352
24008992020,0cyclictest0-21swapper/207:30:352
24008992018,1cyclictest0-21swapper/208:35:002
2400899200,20cyclictest11177-21apt-get07:50:352
24003992020,0cyclictest7637-21apt-get08:50:351
2400399200,0cyclictest0-21swapper/108:10:351
2399999202,18cyclictest18874-21kworker/0:207:27:440
23999992020,0cyclictest0-21swapper/008:40:360
23999992020,0cyclictest0-21swapper/008:15:360
24010991919,0cyclictest0-21swapper/307:50:353
24008991919,0cyclictest25656-21apt-get08:20:342
24003991919,0cyclictest31493-21apt-get07:25:351
24003991919,0cyclictest0-21swapper/109:00:341
24003991919,0cyclictest0-21swapper/108:05:351
24003991919,0cyclictest0-21swapper/107:45:341
23999991919,0cyclictest0-21swapper/008:05:350
23999991916,2cyclictest18097-21perf08:05:010
24010991818,0cyclictest0-21swapper/307:25:353
24010991817,1cyclictest28052-21apt-get08:25:363
24010991816,2cyclictest2542-21latency_hist08:40:003
24003991818,0cyclictest0-21swapper/108:45:351
23999991818,0cyclictest0-21swapper/007:45:340
2399999181,17cyclictest18874-21kworker/0:209:06:160
2399999180,0cyclictest29096-21apt-get07:20:340
24010991716,1cyclictest5240-21apt-get08:45:353
24010991716,0cyclictest0-21swapper/307:30:353
24008991717,0cyclictest18386-21apt-get08:05:352
24008991717,0cyclictest0-21swapper/207:35:332
24008991717,0cyclictest0-21swapper/207:25:352
24008991715,1cyclictest28778-21awk07:20:012
24008991714,2cyclictest10877-21apt07:50:002
24003991717,0cyclictest13577-21apt-get07:55:361
24003991717,0cyclictest0-21swapper/108:40:361
24003991717,0cyclictest0-21swapper/107:20:341
24003991717,0cyclictest0-21swapper/107:10:371
24003991714,2cyclictest17398-21cut09:10:001
23999991717,0cyclictest0-21swapper/007:10:370
24010991616,0cyclictest0-21swapper/307:55:363
24010991614,1cyclictest0-21swapper/307:10:313
2400899160,15cyclictest0-21swapper/208:30:002
2400399160,15cyclictest18140-21wc08:05:011
23999991615,1cyclictest13-21ksoftirqd/007:20:010
23999991614,1cyclictest22925-21dump-pmu-power08:15:010
23999991614,1cyclictest0-21swapper/007:35:340
2399999160,1cyclictest0-21swapper/008:35:400
24010991515,0cyclictest0-21swapper/308:05:353
2401099150,14cyclictest0-21swapper/308:00:363
2400899157,7cyclictest790-21sshd09:00:342
24008991515,0cyclictest0-21swapper/208:15:362
24003991513,1cyclictest27764-21munin-run08:25:001
2399999150,14cyclictest0-21swapper/008:30:230
24010991413,1cyclictest0-21swapper/308:40:363
2401099140,14cyclictest0-21swapper/308:32:023
2401099140,14cyclictest0-21swapper/308:13:183
2401099140,0cyclictest0-21swapper/307:45:503
2400899140,14cyclictest0-21swapper/209:07:352
2400899140,14cyclictest0-21swapper/207:10:352
24003991414,0cyclictest0-21swapper/108:55:351
24003991414,0cyclictest0-21swapper/107:50:161
2400399140,14cyclictest0-21swapper/107:40:421
2400899130,0cyclictest0-21swapper/208:00:092
24003991313,0cyclictest0-21swapper/107:15:091
24003991211,1cyclictest28225-21expr08:25:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional