You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 16:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Wed Jul 15, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25965992928,1cyclictest20109-21diskmemload11:37:002
2596599278,19cyclictest28-21ksoftirqd/211:46:592
2597099250,24cyclictest12052-21cron10:00:013
2597099250,1cyclictest0-21swapper/309:35:273
25965992521,3cyclictest24340-21awk12:05:002
25965992520,4cyclictest0-21swapper/209:10:112
2596599250,24cyclictest20109-21diskmemload09:35:142
2596599250,24cyclictest0-21swapper/212:20:482
2596599250,24cyclictest0-21swapper/209:25:082
25970992424,0cyclictest0-21swapper/310:11:283
25970992422,1cyclictest0-21swapper/312:20:513
25970992421,2cyclictest12688-21ssh10:29:193
2597099240,24cyclictest20109-21diskmemload10:33:373
2597099240,23cyclictest7003-21diskmemload12:17:313
25965992422,1cyclictest0-21swapper/212:13:422
25965992420,3cyclictest5738-21sh11:19:532
2596599240,24cyclictest0-21swapper/212:09:102
2596599240,24cyclictest0-21swapper/212:09:102
2596599240,23cyclictest271rcuc/211:30:082
2596599240,23cyclictest20109-21diskmemload09:43:172
2596599240,23cyclictest20109-21diskmemload09:24:312
2596599240,23cyclictest0-21swapper/209:56:422
2596599240,22cyclictest0-21swapper/210:11:382
2596299240,24cyclictest0-21swapper/112:03:181
2596299240,24cyclictest0-21swapper/110:59:491
2596299240,23cyclictest7361-21ssh09:56:051
2596299240,23cyclictest24953-21ssh10:12:011
2596299240,23cyclictest20109-21diskmemload09:15:011
2596299240,23cyclictest13974-21ssh12:24:271
2596299240,0cyclictest20109-21diskmemload11:37:421
2596299240,0cyclictest0-21swapper/109:22:151
2596099240,24cyclictest0-21swapper/010:12:250
2596099240,24cyclictest0-21swapper/009:50:310
2596099240,24cyclictest0-21swapper/009:32:100
2596099240,24cyclictest0-21swapper/009:28:000
2596099240,23cyclictest29109-21rm09:46:580
2596099240,23cyclictest24944-21sh12:33:520
2596099240,23cyclictest20109-21diskmemload10:45:270
2596099240,23cyclictest20109-21diskmemload09:36:460
2596099240,23cyclictest0-21swapper/010:22:140
25970992323,0cyclictest0-21swapper/312:12:143
25970992323,0cyclictest0-21swapper/309:22:253
25970992322,1cyclictest20109-21diskmemload12:05:573
25970992322,1cyclictest20109-21diskmemload12:05:573
25970992322,1cyclictest20109-21diskmemload10:58:003
25970992322,1cyclictest0-21swapper/311:04:363
25970992321,1cyclictest6172-21sh09:54:493
25970992321,1cyclictest20922-21apt-get08:07:153
25970992321,1cyclictest0-21swapper/311:16:483
25970992321,1cyclictest0-21swapper/310:48:553
25970992320,2cyclictest15898-21needreboot11:57:203
2597099230,22cyclictest29378-21ssh11:40:573
2597099230,22cyclictest24607-21ssh11:37:083
2597099230,22cyclictest18393-21ssh10:05:433
2597099230,22cyclictest0-21swapper/311:47:173
2597099230,0cyclictest20109-21diskmemload11:21:243
2597099230,0cyclictest20109-21diskmemload09:17:563
2597099230,0cyclictest0-21swapper/310:15:323
2597099230,0cyclictest0-21swapper/309:29:323
25965992323,0cyclictest28-21ksoftirqd/210:50:102
25965992323,0cyclictest0-21swapper/210:39:582
25965992321,1cyclictest3742-21apt-get07:30:022
25965992321,1cyclictest0-21swapper/211:51:082
25965992321,1cyclictest0-21swapper/210:00:432
25965992320,2cyclictest622-21gdbus10:45:012
25965992320,2cyclictest29324-21ssh10:15:422
2596599230,23cyclictest0-21swapper/209:18:342
2596599230,22cyclictest29262-21ssh11:40:492
2596599230,22cyclictest28-21ksoftirqd/211:13:372
2596599230,22cyclictest20133-21cron12:30:002
2596599230,22cyclictest20109-21diskmemload10:25:432
2596599230,22cyclictest20109-21diskmemload09:49:532
2596599230,22cyclictest15744-21ssh11:00:292
2596599230,22cyclictest0-21swapper/211:23:232
2596599230,0cyclictest20109-21diskmemload12:15:232
2596599230,0cyclictest0-21swapper/212:31:082
2596599230,0cyclictest0-21swapper/210:49:392
25962992323,0cyclictest20109-21diskmemload11:25:211
25962992323,0cyclictest20109-21diskmemload11:17:041
25962992323,0cyclictest20109-21diskmemload09:18:131
25962992323,0cyclictest0-21swapper/110:43:031
25962992320,2cyclictest25570-21ssh12:06:251
25962992320,2cyclictest25570-21ssh12:06:251
2596299230,2cyclictest13749-21ssh10:30:271
2596299230,23cyclictest0-21swapper/111:40:561
2596299230,23cyclictest0-21swapper/111:10:081
2596299230,23cyclictest0-21swapper/110:54:291
2596299230,23cyclictest0-21swapper/109:34:521
2596299230,22cyclictest32351-21ssh10:46:551
2596299230,22cyclictest30221-21ssh10:16:471
2596299230,22cyclictest23795-21sh10:38:521
2596299230,22cyclictest2298-21ssh10:20:111
2596299230,22cyclictest17237-21ssh11:58:141
2596299230,0cyclictest0-21swapper/111:52:041
2596299230,0cyclictest0-21swapper/111:22:111
2596299230,0cyclictest0-21swapper/111:03:441
2596299230,0cyclictest0-21swapper/110:09:011
25960992323,0cyclictest0-21swapper/012:28:530
25960992323,0cyclictest0-21swapper/011:05:090
25960992323,0cyclictest0-21swapper/010:05:060
25960992323,0cyclictest0-21swapper/010:01:040
25960992323,0cyclictest0-21swapper/009:23:180
25960992321,1cyclictest62550irq/127-eno112:12:510
25960992321,1cyclictest29908-21sh10:44:330
25960992321,1cyclictest0-21swapper/010:30:060
25960992320,2cyclictest24445-21sh11:36:560
2596099231,1cyclictest62550irq/127-eno112:00:420
2596099230,23cyclictest20109-21diskmemload09:55:480
2596099230,23cyclictest0-21swapper/011:10:470
2596099230,23cyclictest0-21swapper/010:58:530
2596099230,22cyclictest9302-21sh10:27:080
2596099230,22cyclictest454-21ssh11:15:070
2596099230,22cyclictest31478-21sendmail-msp12:40:000
2596099230,22cyclictest29331-21ssh12:09:130
2596099230,22cyclictest29331-21ssh12:09:130
2596099230,22cyclictest23917-21ssh10:39:010
2596099230,22cyclictest21816-21ssh11:33:400
2596099230,22cyclictest10630-21ssh12:22:110
2596099230,1cyclictest17745-21smartctl11:02:160
2596099230,1cyclictest0-21swapper/011:25:160
2596099230,0cyclictest0-21swapper/011:56:150
2596099230,0cyclictest0-21swapper/011:40:490
2596099230,0cyclictest0-21swapper/010:16:240
25970992222,0cyclictest20109-21diskmemload12:01:073
25970992222,0cyclictest0-21swapper/311:10:383
25970992222,0cyclictest0-21swapper/309:45:383
25970992222,0cyclictest0-21swapper/308:12:143
25970992221,0cyclictest3120-21apt-get07:30:023
25970992220,1cyclictest8169-21rm10:53:053
25970992220,1cyclictest27719-21awk08:20:013
25970992220,1cyclictest20109-21diskmemload11:27:143
2597099220,22cyclictest23349-21sh09:41:513
2597099220,21cyclictest0-21swapper/312:35:033
2597099220,21cyclictest0-21swapper/310:20:193
2597099220,21cyclictest0-21swapper/310:00:453
2597099220,21cyclictest0-21swapper/309:10:053
2597099220,1cyclictest20109-21diskmemload11:53:523
2597099220,1cyclictest0-21swapper/311:32:323
2597099220,1cyclictest0-21swapper/310:44:453
25965992222,0cyclictest28-21ksoftirqd/209:31:382
25965992222,0cyclictest20109-21diskmemload12:38:132
25965992222,0cyclictest0-21swapper/210:07:372
25965992220,1cyclictest10487-21latency_hist08:50:002
25965992220,1cyclictest0-21swapper/211:55:292
25965992220,1cyclictest0-21swapper/211:26:572
2596599220,21cyclictest0-21swapper/211:05:102
2596599220,21cyclictest0-21swapper/210:57:252
2596599220,21cyclictest0-21swapper/210:20:372
2596599220,21cyclictest0-21swapper/209:02:132
25962992222,0cyclictest0-21swapper/112:31:451
25962992222,0cyclictest0-21swapper/109:38:201
25962992222,0cyclictest0-21swapper/109:02:131
25962992221,1cyclictest8316-21rm12:19:171
25962992221,1cyclictest0-21swapper/110:02:401
25962992220,2cyclictest21863-21ssh11:05:591
25962992220,1cyclictest32504-21munin-run08:30:011
25962992220,1cyclictest26254-21ssh12:35:201
25962992220,1cyclictest0-21swapper/109:50:011
25962992219,2cyclictest5111-21sh09:25:181
2596299220,22cyclictest0-21swapper/110:25:021
2596299220,21cyclictest6345-21apt-get07:37:141
2596299220,21cyclictest30342-21ssh12:10:131
2596299220,21cyclictest0-21swapper/112:25:191
2596299220,21cyclictest0-21swapper/107:57:161
2596299220,1cyclictest18336-21ssh11:31:171
2596299220,1cyclictest13300-21apt-get08:57:141
25960992219,2cyclictest3654-21ssh12:15:220
2596099220,2cyclictest2464-21sh08:35:000
2596099220,22cyclictest0-21swapper/011:21:390
2596099220,21cyclictest8437-21perf07:40:010
2596099220,21cyclictest30117-21munin-run08:25:010
2596099220,21cyclictest0-21swapper/011:50:030
2596099220,21cyclictest0-21swapper/009:40:040
2596099220,21cyclictest0-21swapper/009:16:250
2596099220,21cyclictest0-21swapper/009:10:020
2596099220,1cyclictest3584-21apt-get11:47:150
2596099220,1cyclictest0-21swapper/010:50:020
2597099210,21cyclictest0-21swapper/312:32:103
2597099210,20cyclictest0-21swapper/310:36:073
2597099210,20cyclictest0-21swapper/308:57:143
2597099210,20cyclictest0-21swapper/308:22:153
2596599212,18cyclictest28-21ksoftirqd/208:32:122
2596599211,17cyclictest28-21ksoftirqd/208:37:232
2596599210,21cyclictest0-21swapper/210:30:312
2596599210,1cyclictest606-21dbus-daemon08:25:012
2596599210,0cyclictest0-21swapper/208:07:152
25962992121,0cyclictest0-21swapper/108:17:151
25962992120,1cyclictest0-21swapper/109:40:061
25962992119,1cyclictest20498-21perf08:05:001
2596299210,21cyclictest0-21swapper/109:50:021
2596299210,20cyclictest10908-21apt-get08:52:161
2596299210,20cyclictest0-21swapper/109:07:171
2596299210,0cyclictest6113-21apt-get08:42:141
2596299210,0cyclictest31172-21apt-get07:22:141
2596099210,20cyclictest18167-21apt-get09:07:170
2596099210,20cyclictest0-21swapper/007:22:140
2596099210,1cyclictest26359-21apt-get07:12:130
2596099210,0cyclictest0-21swapper/008:17:150
25970992020,0cyclictest0-21swapper/308:35:023
25970992020,0cyclictest0-21swapper/307:52:143
2597099200,0cyclictest0-21swapper/308:42:143
2597099200,0cyclictest0-21swapper/307:47:143
25965992020,0cyclictest0-21swapper/207:47:142
2596599200,20cyclictest0-21swapper/207:22:142
2596599200,0cyclictest0-21swapper/209:07:172
25962992020,0cyclictest0-21swapper/108:32:121
25962992019,0cyclictest0-21swapper/107:30:021
2596299200,20cyclictest0-21swapper/108:47:151
25960992020,0cyclictest0-21swapper/008:55:000
25960992019,0cyclictest0-21swapper/007:30:020
25970991919,0cyclictest0-21swapper/307:57:153
25965991919,0cyclictest0-21swapper/208:42:142
25965991919,0cyclictest0-21swapper/207:37:142
25965991916,2cyclictest28321-21dump-pmu-power07:15:002
25962991919,0cyclictest0-21swapper/108:22:161
25962991919,0cyclictest0-21swapper/108:15:011
25962991919,0cyclictest0-21swapper/107:52:141
2596099190,1cyclictest22904-21perf08:10:000
25970991818,0cyclictest0-21swapper/308:52:163
25970991816,1cyclictest606-21dbus-daemon09:05:013
2596599180,17cyclictest10811-21cron07:45:002
25962991818,0cyclictest11264-21apt-get07:47:131
2596599176,1cyclictest18027-21sh08:00:002
25962991717,0cyclictest0-21swapper/108:07:151
25962991717,0cyclictest0-21swapper/107:12:131
2596299170,17cyclictest0-21swapper/107:28:051
25960991717,0cyclictest0-21swapper/008:40:020
25960991717,0cyclictest0-21swapper/007:27:130
25970991616,0cyclictest463-21apt-get08:32:123
25970991616,0cyclictest0-21swapper/307:42:143
25970991616,0cyclictest0-21swapper/307:12:133
25970991614,1cyclictest313-21systemd-journal07:25:013
2596599165,11cyclictest28-21ksoftirqd/208:52:162
25965991616,0cyclictest0-21swapper/208:17:142
25965991616,0cyclictest0-21swapper/207:27:132
25965991616,0cyclictest0-21swapper/207:17:142
25965991614,1cyclictest0-21swapper/208:02:162
25962991614,1cyclictest0-21swapper/107:42:131
25962991613,2cyclictest5269-21idleruntime-cro08:40:001
2596099164,11cyclictest13664-21apt-get07:52:140
25960991616,0cyclictest23318-21apt-get08:12:140
2596099160,15cyclictest4351-21ntp_states08:37:200
25970991515,0cyclictest0-21swapper/308:27:143
25970991515,0cyclictest0-21swapper/308:02:143
25965991513,1cyclictest30528-21apt-get08:27:142
2596599150,11cyclictest607-21in:imuxsock08:57:422
25962991515,0cyclictest0-21swapper/107:17:141
25960991515,0cyclictest8864-21apt-get07:42:140
25960991515,0cyclictest0-21swapper/008:57:140
2596099150,14cyclictest30745-21munin-run07:20:000
25970991414,0cyclictest0-21swapper/308:45:173
25970991414,0cyclictest0-21swapper/307:16:583
2597099140,14cyclictest0-21swapper/307:35:453
2597099140,0cyclictest0-21swapper/307:26:293
2596599140,14cyclictest0-21swapper/208:13:442
25960991414,0cyclictest0-21swapper/009:01:220
25960991414,0cyclictest0-21swapper/007:55:510
25960991414,0cyclictest0-21swapper/007:48:030
2596099140,14cyclictest0-21swapper/008:46:510
2596099140,14cyclictest0-21swapper/008:25:370
2596099140,14cyclictest0-21swapper/008:00:570
25970991313,0cyclictest0-21swapper/309:05:073
25965991310,2cyclictest0-21swapper/207:52:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional