You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 06:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Sun Jan 11, 2026 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1059429775,6sleep00-21swapper/019:06:540
1059429775,6sleep00-21swapper/019:06:540
1071729480,9sleep20-21swapper/219:08:292
1071729480,9sleep20-21swapper/219:08:292
874729372,15sleep10-21swapper/119:05:141
874729372,15sleep10-21swapper/119:05:141
1063428269,9sleep30-21swapper/319:07:253
1063428269,9sleep30-21swapper/319:07:243
1092899380,19cyclictest0-21swapper/319:30:143
1092899310,30cyclictest0-21swapper/300:05:143
1092899292,23cyclictest3730-21diskmemload21:34:143
1092899280,26cyclictest0-21swapper/323:00:193
1092899280,23cyclictest0-21swapper/321:40:193
1092899270,24cyclictest3730-21diskmemload23:28:303
10923992725,1cyclictest0-21swapper/123:40:191
1092899260,25cyclictest0-21swapper/322:59:143
1092899260,23cyclictest3730-21diskmemload21:48:553
1092899260,1cyclictest0-21swapper/322:07:213
10919992625,1cyclictest0-21swapper/022:06:430
1092899252,20cyclictest0-21swapper/323:45:123
1092899251,23cyclictest3730-21diskmemload00:27:253
1092899250,22cyclictest0-21swapper/322:55:013
1092899250,22cyclictest0-21swapper/322:55:013
1092899250,20cyclictest0-21swapper/322:25:143
1092899250,0cyclictest0-21swapper/321:57:043
1092899242,21cyclictest3730-21diskmemload23:55:183
1092899242,19cyclictest3730-21diskmemload23:34:093
1092899242,16cyclictest3730-21diskmemload00:00:393
1092899241,19cyclictest24584-21grep19:35:203
1092899240,23cyclictest0-21swapper/323:44:403
1092899240,21cyclictest0-21swapper/323:11:163
1092899240,20cyclictest0-21swapper/323:39:473
1092899232,20cyclictest3730-21diskmemload00:36:463
1092899232,18cyclictest3730-21diskmemload00:23:053
1092899231,21cyclictest3730-21diskmemload22:13:243
1092899231,21cyclictest3730-21diskmemload21:11:123
1092899231,18cyclictest0-21swapper/320:20:143
1092899230,22cyclictest3730-21diskmemload22:15:083
1092899230,21cyclictest3730-21diskmemload22:00:383
1092899230,1cyclictest0-21swapper/322:40:153
1092899230,1cyclictest0-21swapper/321:24:213
1092899230,1cyclictest0-21swapper/300:34:433
10925992321,1cyclictest10793-21apt-get00:05:142
1092399230,23cyclictest0-21swapper/122:49:521
1092399230,22cyclictest0-21swapper/122:41:551
10919992322,1cyclictest0-21swapper/022:16:240
1092899222,20cyclictest3730-21diskmemload21:53:463
1092899220,21cyclictest19294-21ssh00:10:103
1092899220,1cyclictest0-21swapper/323:22:053
1092899220,0cyclictest0-21swapper/300:16:423
1092399220,0cyclictest0-21swapper/122:39:571
1092399220,0cyclictest0-21swapper/100:05:341
1092899212,19cyclictest3730-21diskmemload21:16:173
1092899212,12cyclictest21785-21apache219:20:013
1092899211,1cyclictest0-21swapper/322:30:023
1092899210,1cyclictest0-21swapper/323:50:133
1092899210,1cyclictest0-21swapper/322:23:023
1091999210,20cyclictest0-21swapper/000:03:000
82662200,3sleep013-21ksoftirqd/023:05:350
1092899202,17cyclictest3730-21diskmemload22:45:273
1092899201,18cyclictest3730-21diskmemload22:39:143
1092899200,20cyclictest0-21swapper/321:35:523
1092899200,1cyclictest0-21swapper/321:28:493
1092899200,18cyclictest0-21swapper/323:19:133
10923992018,1cyclictest0-21swapper/123:03:541
1091999207,6cyclictest5791-21idleruntime-cro21:30:000
1092899198,8cyclictest32315-21taskset19:51:453
1092899191,17cyclictest0-21swapper/320:35:123
1092899190,1cyclictest0-21swapper/321:00:213
1092899190,1cyclictest0-21swapper/321:00:203
1092899190,18cyclictest0-21swapper/323:05:143
1092899190,16cyclictest0-21swapper/320:15:223
1092399190,1cyclictest0-21swapper/123:58:381
1091999190,4cyclictest0-21swapper/022:02:340
1092599180,17cyclictest0-21swapper/219:50:122
1092399180,1cyclictest0-21swapper/123:14:471
1091999180,2cyclictest0-21swapper/021:35:470
1091999180,1cyclictest141rcu_preempt22:10:240
10928991713,4cyclictest0-21swapper/319:10:133
1092399171,1cyclictest10913-21cyclictest23:21:521
1092399171,14cyclictest0-21swapper/123:39:001
1092399170,1cyclictest0-21swapper/123:48:271
1092399170,1cyclictest0-21swapper/100:03:031
1092899163,12cyclictest24245-21cron20:45:003
1092899160,15cyclictest28123-21cut19:45:133
1092899160,14cyclictest0-21swapper/321:05:143
1092899160,14cyclictest0-21swapper/319:25:173
1092899160,13cyclictest0-21swapper/320:00:233
10925991615,1cyclictest32-21ksoftirqd/223:19:492
10925991615,1cyclictest0-21swapper/222:05:262
10923991614,1cyclictest38150irq/131-snd_hda00:35:131
1092399160,1cyclictest0-21swapper/123:29:541
1092399160,1cyclictest0-21swapper/100:34:521
1091999160,1cyclictest0-21swapper/023:14:170
10925991515,0cyclictest0-21swapper/200:37:422
1092399150,1cyclictest0-21swapper/121:25:131
1092399150,0cyclictest0-21swapper/122:21:421
1092899149,4cyclictest15009-21grep20:25:143
1092899148,5cyclictest9360-21wc20:10:283
1092899147,6cyclictest18355-21date19:25:003
1092899141,9cyclictest27376-21df20:50:143
1092899140,12cyclictest27454-21uptime19:40:273
1092599149,4cyclictest28256-21grep00:15:142
1092599141,5cyclictest3730-21diskmemload22:10:232
10925991412,2cyclictest1756-21sendmail_mailst19:55:242
10925991411,2cyclictest29336-21grep20:55:122
10925991410,3cyclictest5772-21turbostat21:30:002
1092599140,4cyclictest0-21swapper/222:50:382
1092599140,4cyclictest0-21swapper/222:50:372
1092399144,8cyclictest1266-21aten2_r7power_c22:05:131
10923991411,2cyclictest25093-21grep23:15:281
10923991411,2cyclictest0-21swapper/100:21:061
1091999143,6cyclictest0-21swapper/023:25:210
10919991410,3cyclictest1166-21grep23:20:280
10919991410,2cyclictest4700-21grep22:45:140
10919991410,2cyclictest28606-21grep20:50:270
245952131,1sleep124620-21ssh21:21:111
1092899137,5cyclictest30269-21cat20:55:193
1092899137,5cyclictest25897-21tr20:45:263
1092899137,5cyclictest1081-21cut19:55:183
1092599138,3cyclictest0-21swapper/219:30:012
10925991310,2cyclictest8923-21tr23:25:202
10925991310,2cyclictest21613-21cut22:55:132
10925991310,2cyclictest21023-21cat20:35:232
10925991310,2cyclictest18690-21sh23:12:032
10925991310,2cyclictest15384-21cat21:35:142
10925991310,2cyclictest13240-21grep20:20:172
1092599130,1cyclictest0-21swapper/222:20:082
1092599130,10cyclictest0-21swapper/223:23:132
1092399139,3cyclictest22351-21cut22:55:161
1092399138,4cyclictest3165-21ssh00:19:451
10923991310,2cyclictest23682-21cut21:40:131
1091999139,3cyclictest2840-21grep23:40:280
1091999139,3cyclictest24525-21sed19:35:200
1091999139,3cyclictest2385-21cut21:05:170
1091999132,7cyclictest1067-21grep19:55:180
10919991310,2cyclictest32290-21sort21:00:180
10919991310,2cyclictest32290-21sort21:00:170
10919991310,2cyclictest23181-21grep22:55:240
10919991310,2cyclictest18978-21wc00:10:010
10919991310,2cyclictest15608-21cut20:25:170
10919991310,2cyclictest14852-21uname19:15:180
10919991310,2cyclictest13824-21wc20:20:220
1091999130,12cyclictest24235-21wc23:15:200
1091999130,10cyclictest0-21swapper/022:41:280
1092899120,1cyclictest0-21swapper/320:30:153
1092899120,11cyclictest0-21swapper/320:05:143
1092599129,2cyclictest7818-21sed23:05:272
1092599129,2cyclictest5657-21grep20:05:152
1092599129,2cyclictest28034-21tr20:50:202
1092599129,2cyclictest19437-21rm00:10:122
1092599129,2cyclictest18636-21tail23:50:172
1092599129,2cyclictest17578-21grep20:30:142
1092599129,2cyclictest16779-21tr21:55:142
1092599129,2cyclictest14779-21taskset21:53:592
1092599129,2cyclictest13379-21grep00:25:192
1092599129,2cyclictest12472-21fgrep19:10:212
1092599127,5cyclictest0-21swapper/222:40:472
1092599127,3cyclictest0-21swapper/221:20:102
1092599121,6cyclictest0-21swapper/223:55:192
10925991210,1cyclictest17754-21grep19:20:242
1092599120,11cyclictest0-21swapper/222:30:022
1092399129,2cyclictest8522-21head20:10:191
1092399129,2cyclictest8371-21sort21:50:141
1092399129,2cyclictest6421-21cstates23:05:161
1092399129,2cyclictest5153-21cut21:10:161
1092399129,2cyclictest32445-21head21:00:191
1092399129,2cyclictest32445-21head21:00:181
1092399129,2cyclictest30971-21head20:55:251
1092399129,2cyclictest26622-21cron20:50:011
1092399129,2cyclictest2546-21run-parts20:00:001
1092399129,2cyclictest22914-21grep20:40:171
1092399129,2cyclictest21342-21head00:10:281
1092399129,2cyclictest1858-21tr21:05:151
1092399129,2cyclictest17573-21tr20:30:131
1092399129,2cyclictest13530-21cat19:15:001
1092399129,2cyclictest12251-21head22:30:171
1092399129,2cyclictest10957-21chrt20:15:181
1092399128,3cyclictest3382-21ssh21:46:451
1092399127,4cyclictest30694-21ssh22:03:081
1092399127,3cyclictest20739-21ssh22:15:491
1092399127,2cyclictest19841-21ssh23:31:471
1091999129,2cyclictest4945-21ssh22:25:270
1091999129,2cyclictest32584-21turbostat.cron19:54:590
1091999129,2cyclictest30972-21sed20:55:250
1091999129,2cyclictest286952sleep021:42:480
1091999129,2cyclictest26327-21sort19:40:160
1091999129,2cyclictest26309-21cut23:55:130
1091999129,2cyclictest21339-21tr22:35:280
1091999129,2cyclictest20045-21uniq00:10:160
1091999129,2cyclictest19419-21cron20:34:590
1091999129,2cyclictest0-21swapper/000:38:580
1091999129,1cyclictest12610-21grep00:25:140
1091999128,3cyclictest18576-21head21:55:270
1091999126,4cyclictest12496-21dump-pmu-power21:15:010
1091999124,4cyclictest225-21systemd-journal21:54:590
1091999123,8cyclictest17718-21sensors23:30:250
10919991210,2cyclictest12973-21kworker/u8:221:19:410
10919991210,2cyclictest0-21swapper/023:39:420
1091999120,0cyclictest0-21swapper/021:30:390
1092599118,2cyclictest9883-21cron20:15:002
1092599118,2cyclictest9058-21ssh22:28:362
1092599118,2cyclictest8985-21ssh23:45:002
1092599118,2cyclictest8593-21ssh22:47:012
1092599118,2cyclictest5289-21ssh23:42:192
1092599118,2cyclictest3329-21ssh23:03:182
1092599118,2cyclictest31506-21ssh22:03:452
1092599118,2cyclictest28963-21munin-plugin-st00:35:012
1092599118,2cyclictest26297-21taskset19:40:162
1092599118,2cyclictest24794-21ssh23:35:122
1092599118,2cyclictest23395-21grep19:35:122
1092599118,2cyclictest2283-21ssh00:00:102
1092599118,2cyclictest22562-21cat20:40:142
1092599118,2cyclictest21283-21grep22:35:262
1092599118,2cyclictest13010-21cut21:15:132
1092599111,10cyclictest9081-21ssh21:12:242
1092399119,1cyclictest26965-21cut20:50:141
1092399119,1cyclictest24436-21cut19:35:181
1092399119,1cyclictest20796-21cut20:35:201
1092399118,2cyclictest8192-21ssh22:27:561
1092399118,2cyclictest4064-21tr20:00:221
1092399118,2cyclictest30742-21tr19:50:131
1092399118,2cyclictest28867-21sed19:45:171
1092399118,2cyclictest21991-21cat19:30:201
1092399118,2cyclictest18244-21cron19:25:001
1092399118,2cyclictest17505-21ssh23:50:021
1092399118,2cyclictest17309-21grep21:55:171
1092399118,2cyclictest16239-21ssh22:51:241
1092399118,2cyclictest16239-21ssh22:51:231
1092399118,2cyclictest15621-21ssh21:15:541
1092399118,2cyclictest14843-21ssh00:25:411
1092399118,2cyclictest10203-21ssh21:31:541
1092399118,2cyclictest10025-21grep22:10:151
1092399115,2cyclictest16504-21grep21:35:221
1092399113,4cyclictest225-21systemd-journal20:09:591
1092399113,4cyclictest225-21systemd-journal19:25:191
1091999118,2cyclictest9828-21taskset20:14:190
1091999118,2cyclictest6088-21grep20:05:160
1091999118,2cyclictest4022-21ssh21:47:150
1091999118,2cyclictest29528-21sh22:20:590
1091999118,2cyclictest28658-21cut00:15:150
1091999118,2cyclictest25252-21grep20:45:170
1091999118,2cyclictest23427-21sort21:20:280
1091999118,2cyclictest22252-21tr20:40:140
1091999118,2cyclictest21662-21cut00:30:160
1091999118,2cyclictest20821-21grep20:35:200
1091999118,2cyclictest19264-21sh23:50:210
1091999118,2cyclictest13607-21ssh22:50:150
1091999118,2cyclictest13607-21ssh22:50:140
1091999118,2cyclictest12624-21grep22:30:190
1091999118,2cyclictest10394-21tr20:15:140
1091999110,10cyclictest1120-21rm23:01:360
1092599108,2cyclictest18671-21expr22:15:162
1092599108,2cyclictest15750-21chrt19:18:462
1092599108,1cyclictest9859-21ssh21:31:392
1092599108,1cyclictest3767-21sh00:20:012
1092599108,1cyclictest31888-21ssh21:45:042
1092599108,1cyclictest24758-21cut20:45:142
1092599108,1cyclictest23490-21sh21:40:092
1092599108,1cyclictest16227-21basename23:30:152
1092599108,1cyclictest101172sleep220:15:032
1092599107,2cyclictest15412-21expr20:25:152
1092599107,2cyclictest1188-21taskset21:03:052
1092599107,2cyclictest1188-21taskset21:03:042
1092399108,1cyclictest15140-21cat20:25:151
1092399108,1cyclictest13229-21grep20:20:171
1092399107,2cyclictest25933-21cat19:40:151
1092399107,2cyclictest15558-21taskset19:16:201
1091999108,1cyclictest20857-21chrt19:30:060
1091999108,1cyclictest11833-21grep19:10:150
1091999107,2cyclictest5617-21readlink00:20:230
1091999107,2cyclictest4585-21taskset20:00:410
1091999107,2cyclictest28054-21taskset19:45:010
1091999107,2cyclictest20318-21chrt19:26:080
1091999106,3cyclictest21841-21apache223:45:120
109259998,1cyclictest3015-21cpuspeed_turbos20:00:152
109259998,1cyclictest21359-21expr19:30:152
109259997,2cyclictest2048-21cat21:05:152
109259996,2cyclictest29668-21cat19:45:272
109199996,2cyclictest16223-21cut19:20:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional