You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 22:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot7s.osadl.org (updated Fri Jun 05, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1308629784,9sleep00-21swapper/007:09:270
1304929667,9sleep30-21swapper/307:08:573
1297929279,9sleep20-21swapper/207:08:032
1310928568,13sleep10-21swapper/107:09:441
220732520,0sleep10-21swapper/110:35:431
1321799266,19cyclictest0-21swapper/107:15:131
1321799260,25cyclictest0-21swapper/110:55:511
1321599260,7cyclictest0-21swapper/009:47:390
1322199231,2cyclictest0-21swapper/211:19:462
13221992221,0cyclictest0-21swapper/212:35:112
1322199220,20cyclictest0-21swapper/209:29:482
1321799220,2cyclictest0-21swapper/109:17:581
1321599228,7cyclictest5763-21munin-run11:25:000
13223992118,2cyclictest0-21swapper/307:15:123
13217992113,8cyclictest0-21swapper/112:18:081
1321799210,20cyclictest0-21swapper/111:20:081
13217992020,0cyclictest0-21swapper/112:09:181
1321799201,18cyclictest1-21systemd11:10:221
1322199190,18cyclictest0-21swapper/210:52:562
13217991917,2cyclictest0-21swapper/110:50:251
13217991914,0cyclictest0-21swapper/111:06:021
1321599190,1cyclictest0-21swapper/010:49:310
1322199180,17cyclictest0-21swapper/209:20:172
1322199180,13cyclictest0-21swapper/210:35:142
1321799180,18cyclictest0-21swapper/110:08:581
1322399171,7cyclictest225-21systemd-journal10:15:013
1322399171,2cyclictest0-21swapper/309:55:123
1322399170,17cyclictest0-21swapper/312:09:023
1322199170,2cyclictest0-21swapper/209:13:502
13217991716,1cyclictest0-21swapper/112:39:391
1322399162,13cyclictest26692-21apache_accesses10:20:123
1322199167,8cyclictest7406-21apt-get11:45:132
13221991611,4cyclictest1198-21grep09:45:162
1321799162,3cyclictest7238-21munin-run09:30:001
13217991615,1cyclictest0-21swapper/109:31:031
1321799161,1cyclictest0-21swapper/109:22:201
13215991615,1cyclictest0-21swapper/009:51:170
13223991510,4cyclictest10745-21munin-plugin-st10:30:003
1322399150,14cyclictest0-21swapper/312:01:233
1322399150,0cyclictest0-21swapper/311:15:013
1322199150,1cyclictest0-21swapper/211:33:302
1322199150,14cyclictest0-21swapper/211:25:322
1322199150,0cyclictest0-21swapper/210:41:392
1321799151,14cyclictest0-21swapper/111:16:201
13217991511,3cyclictest25324-21tr09:40:171
1321799150,1cyclictest0-21swapper/112:13:091
1321799150,1cyclictest0-21swapper/111:00:581
1321799150,1cyclictest0-21swapper/110:44:151
1321799150,15cyclictest0-21swapper/111:52:461
1321799150,15cyclictest0-21swapper/110:48:051
1322399149,4cyclictest7695-21apt-get09:30:103
13223991412,1cyclictest0-21swapper/312:10:153
13223991411,2cyclictest21685-21wc08:35:003
1322399141,12cyclictest0-21swapper/309:35:383
13223991410,3cyclictest3588-21cron10:44:593
13223991410,3cyclictest14556-21cut07:10:203
13223991410,2cyclictest17027-21sed09:15:283
1322399140,13cyclictest26733-21cat10:00:193
1322199149,4cyclictest28889-21sh11:38:282
1322199147,7cyclictest32-21ksoftirqd/211:10:262
1322199143,4cyclictest24929-21ssh12:15:012
13221991413,1cyclictest0-21swapper/209:04:472
13221991411,2cyclictest7901-21cut08:05:172
13221991410,2cyclictest7778-21cut09:30:112
13221991410,2cyclictest25452-21tr12:15:122
1322199140,3cyclictest0-21swapper/210:56:332
1322199140,13cyclictest20557-21ssh10:15:382
13217991411,2cyclictest0-21swapper/111:56:281
13217991410,3cyclictest8332-21ssh11:45:171
13217991410,2cyclictest32243-21cut11:40:151
1321599148,2cyclictest12443-21apt-get10:50:140
13215991411,2cyclictest20502-21chrt10:35:180
1321599140,13cyclictest0-21swapper/011:12:400
1322399139,3cyclictest2842-21ssh09:26:343
1322399139,3cyclictest19327-21grep07:20:193
1322399139,3cyclictest16530-21cron08:25:003
1322399139,2cyclictest31963-21sort08:55:153
1322399139,2cyclictest17394-21cron12:30:003
1322399138,5cyclictest23060-21kworker/u8:109:44:403
1322399135,6cyclictest6031-21diskmemload10:30:253
13223991311,2cyclictest39-21ksoftirqd/311:17:493
13223991310,2cyclictest27112-21grep07:35:293
13223991310,2cyclictest25826-21awk11:55:253
13223991310,2cyclictest24782-21sort11:35:273
13223991310,2cyclictest15501-21grep11:30:183
13223991310,2cyclictest10223-21wc09:50:203
1322399130,12cyclictest201532sleep312:30:373
1322199139,3cyclictest4097-21grep10:25:192
1322199139,3cyclictest30453-21tr07:45:152
1322199139,3cyclictest10145-21wc12:05:252
1322199131,2cyclictest225-21systemd-journal08:23:282
13221991310,2cyclictest5856-21sort10:45:252
13221991310,2cyclictest14667-21grep07:10:222
1322199130,12cyclictest0-21swapper/209:37:342
1321799139,3cyclictest7645-21cat09:10:181
1321799139,3cyclictest12524-21wc10:30:171
13217991310,2cyclictest29312-21cat07:40:261
13217991310,2cyclictest2897-21wc12:20:241
13217991310,2cyclictest27567-21head10:20:161
1321799130,12cyclictest0-21swapper/109:52:011
1321599139,3cyclictest870-21grep07:50:170
1321599139,2cyclictest25245-21cat08:40:190
1321599133,6cyclictest17793-21dump-pmu-power10:15:000
13215991310,2cyclictest7257-21ssh09:30:000
13215991310,2cyclictest27544-21grep10:00:260
13215991310,2cyclictest18388-21ssh09:55:190
13215991310,2cyclictest17279-21grep08:25:140
1322399129,2cyclictest9882-21tr08:10:133
1322399129,2cyclictest9715-21chrt11:26:333
1322399129,2cyclictest935-21sed11:40:243
1322399129,2cyclictest9068-21sort11:45:253
1322399129,2cyclictest8507-21tr08:05:223
1322399129,2cyclictest640-21sh12:19:593
1322399129,2cyclictest4634-21systemctl07:59:593
1322399129,2cyclictest30551-21tr11:20:143
1322399129,2cyclictest27631-21cron10:39:593
1322399129,2cyclictest2392-21cut12:20:193
1322399129,2cyclictest22489-21grep08:35:193
1322399129,2cyclictest22489-21grep08:35:183
1322399129,2cyclictest2072-21df09:00:133
1322399129,2cyclictest19085-21grep10:15:153
1322399129,2cyclictest1820-21sed07:50:283
1322399128,3cyclictest7121-21wc08:05:003
1322399128,3cyclictest24118-21cut09:20:163
1322399128,2cyclictest26806-21tr12:35:153
13223991212,0cyclictest0-21swapper/310:52:383
1322399120,9cyclictest22500-21ssh10:55:263
1322199129,2cyclictest32437-21grep08:55:192
1322199129,2cyclictest3053-21df07:55:152
1322199129,2cyclictest26880-21needreboot10:00:202
1322199129,2cyclictest25703-21tr07:35:172
1322199129,2cyclictest23756-21grep07:30:152
1322199129,2cyclictest21492-21cron08:35:012
1322199129,2cyclictest1900-21cut10:05:142
1322199129,2cyclictest17570-21sed11:50:252
1322199129,2cyclictest17245-21tr08:25:142
1322199129,2cyclictest16936-21sh09:15:282
1322199127,5cyclictest0-21swapper/209:05:122
1322199123,5cyclictest225-21systemd-journal09:44:592
1322199121,3cyclictest13348-21sed10:30:242
13221991210,2cyclictest0-21swapper/211:42:452
13221991210,1cyclictest17775-21df09:55:142
13221991210,1cyclictest10707-21grep10:10:152
1322199120,1cyclictest25602-21kworker/u8:011:56:242
1322199120,0cyclictest0-21swapper/212:00:042
1321799129,2cyclictest7045-21tail11:25:171
1321799129,2cyclictest314-21grep07:50:161
1321799129,2cyclictest2376-21grep09:45:261
1321799129,2cyclictest2241-21head09:00:151
1321799129,2cyclictest19314-21chrt11:32:321
1321799129,2cyclictest1495-21wc12:00:201
1321799129,2cyclictest14571-21tr07:10:201
1321799129,2cyclictest11120-21cut10:10:171
1321799128,4cyclictest25927-21ssh11:36:091
13217991211,1cyclictest38150irq/131-snd_hda12:33:261
13217991210,1cyclictest11476-21grep12:25:261
1321799120,10cyclictest1074-21cron10:05:011
1321599129,2cyclictest9881-21wc12:05:210
1321599129,2cyclictest8376-21grep08:05:210
1321599129,2cyclictest7748-21ssh12:04:520
1321599129,2cyclictest7201-21grep09:10:150
1321599129,2cyclictest5003-21grep09:05:180
1321599129,2cyclictest3562-21cat07:55:200
1321599129,2cyclictest31281-21grep07:45:200
1321599129,2cyclictest3004-21sed10:05:220
1321599129,2cyclictest2936-21tr10:25:130
1321599129,2cyclictest27572-21cut10:20:160
1321599129,2cyclictest26000-21sed12:35:000
1321599129,2cyclictest24915-21grep11:35:270
1321599129,2cyclictest20036-21grep08:30:160
1321599129,2cyclictest16540-21munin-plugin-st08:25:010
1321599129,2cyclictest16335-21cat11:30:260
1321599129,2cyclictest16125-21grep09:35:140
1321599128,3cyclictest26170-21sed07:35:180
1321599128,3cyclictest15804-21tr11:50:140
1321599123,8cyclictest17975-21sendmail07:20:000
1321599123,5cyclictest13345-21grep10:30:240
1321599122,3cyclictest0-21swapper/010:15:120
13215991211,1cyclictest13-21ksoftirqd/012:17:240
1321599120,6cyclictest31096-21perf08:55:010
1322399118,3cyclictest39-21ksoftirqd/310:05:193
1322399118,2cyclictest7460-21cat09:10:163
1322399118,2cyclictest6984-21sh11:05:263
1322399118,2cyclictest4630-21tail09:05:163
1322399118,2cyclictest31315-21ssh11:00:283
1322399118,2cyclictest23762-21grep07:30:153
1322399118,2cyclictest20461-21sh11:52:363
1322399118,2cyclictest18339-21wc08:25:223
1322399118,2cyclictest1511-21wc09:45:193
1322399117,3cyclictest4141-21cut10:45:133
1322199118,2cyclictest9863-21seq12:25:142
1322199118,2cyclictest9818-21ssh09:50:182
1322199118,2cyclictest9784-21wget08:10:122
1322199118,2cyclictest4949-21ssh11:05:022
1322199118,2cyclictest3274-21ssh11:23:042
1322199118,2cyclictest31850-21ssh11:00:552
1322199118,2cyclictest28564-21head07:40:172
1322199118,2cyclictest26824-21basename10:20:142
1322199118,2cyclictest2579-21ssh12:20:202
1322199118,2cyclictest24487-21grep08:40:142
1322199118,2cyclictest22980-21sed08:35:232
1322199118,2cyclictest22980-21sed08:35:222
1322199118,2cyclictest20853-21grep07:25:152
1322199118,2cyclictest17898-21ssh12:30:112
1322199118,2cyclictest1584-21sort07:50:272
1321799118,2cyclictest4225-21expr09:05:131
1321799118,2cyclictest3760-21head10:25:171
1321799118,2cyclictest30818-21taskset08:51:501
1321799118,2cyclictest21520-21uname07:25:201
1321799118,2cyclictest21361-21taskset08:33:261
1321799118,2cyclictest18251-21basename07:20:131
1321799118,2cyclictest17053-21cat09:35:191
1321799118,2cyclictest1219-21sort09:00:001
1321799113,8cyclictest6031-21diskmemload10:15:501
1321799110,10cyclictest17095-21sh09:55:081
1321799110,10cyclictest13837-21seq08:16:171
1321599118,2cyclictest9918-21tr08:10:130
1321599118,2cyclictest9171-21ssh09:30:190
1321599118,2cyclictest5784-21ssh11:05:150
1321599118,2cyclictest31888-21expr11:40:130
1321599118,2cyclictest31573-21tr08:55:120
1321599118,2cyclictest3150-21grep09:00:240
1321599118,2cyclictest30604-21ssh11:58:560
1321599118,2cyclictest30100-21grep10:40:250
1321599118,2cyclictest29084-21rm11:00:060
1321599118,2cyclictest28712-21sh12:35:340
1321599118,2cyclictest28420-21ssh09:41:560
1321599118,2cyclictest28406-21sort07:40:170
1321599118,2cyclictest28345-21rm11:18:540
1321599118,2cyclictest26616-21ssh10:58:210
1321599118,2cyclictest25152-21cat09:20:240
1321599118,2cyclictest23008-21grep07:30:130
1321599118,2cyclictest20864-21ssh12:12:030
1321599118,2cyclictest1948-21expr12:20:150
1321599118,2cyclictest18486-21tr07:20:130
1321599118,2cyclictest15034-21ssh09:15:140
1321599118,2cyclictest13675-21expr07:10:140
1321599118,2cyclictest12782-21rm12:26:250
1321599118,2cyclictest11287-21ssh11:27:480
1321599117,3cyclictest23932-21sendmail08:40:010
1321599117,3cyclictest23932-21sendmail08:40:000
1321599113,6cyclictest7365-21acpi11:45:100
1322399108,1cyclictest277722sleep307:40:103
1322399108,1cyclictest24702-21df_abs08:40:153
1322399108,1cyclictest20576-21basename07:25:123
1322399107,2cyclictest30428-21grep07:45:153
1322399107,2cyclictest28626-21chrt08:49:143
1322399106,3cyclictest30287-21fgrep08:50:213
1322199108,1cyclictest69382sleep208:04:122
1322199108,1cyclictest30763-21chrt08:51:082
1322199108,1cyclictest17586-21taskset07:15:382
1322199108,1cyclictest139422sleep208:17:362
1322199107,2cyclictest27817-21head08:45:222
1322199107,2cyclictest19979-21chrt07:20:332
1321799108,1cyclictest27222-21taskset07:36:201
1321799108,1cyclictest237042sleep108:37:181
1321799108,1cyclictest237042sleep108:37:171
1321799108,1cyclictest23301-21expr07:30:141
1321799108,1cyclictest165032sleep108:24:441
1321799108,1cyclictest10243-21fschecks_count08:10:151
1321799107,2cyclictest7561-21cut08:05:151
1321799107,2cyclictest5109-21cat08:00:131
1321799107,2cyclictest4121-21grep07:55:261
1321799107,2cyclictest17065-21cut08:25:131
1321799104,5cyclictest27308-21head08:45:171
1321799104,2cyclictest225-21systemd-journal08:45:001
1321599108,1cyclictest28390-21chrt08:46:110
1321599107,2cyclictest20865-21grep07:25:150
1321599107,2cyclictest14154-21sendmail08:20:000
132179997,1cyclictest30461-21cut07:45:151
132159997,1cyclictest5724-21basename08:00:160
132239986,1cyclictest12125-21wget08:15:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional