You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 03:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Thu May 07, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
521899270,0cyclictest34-21ksoftirqd/321:48:373
521899261,23cyclictest34-21ksoftirqd/322:11:263
5207992623,2cyclictest0-21swapper/023:11:340
5218992523,1cyclictest3944-21ssh22:36:543
5218992522,2cyclictest21025-21ssh23:48:533
521899250,2cyclictest25151-21sh21:59:403
521899250,24cyclictest32056-21diskmemload22:16:243
521399250,25cyclictest0-21swapper/223:44:492
521399250,24cyclictest32056-21diskmemload00:05:252
521399250,24cyclictest23718-21ssh23:23:082
520799250,24cyclictest0-21swapper/023:31:360
520799250,24cyclictest0-21swapper/021:25:380
520799250,24cyclictest0-21swapper/000:04:520
5218992424,0cyclictest0-21swapper/323:44:493
5218992422,1cyclictest0-21swapper/321:50:513
521899240,24cyclictest0-21swapper/323:23:083
521899240,23cyclictest32056-21diskmemload22:27:473
521899240,23cyclictest0-21swapper/321:40:363
521899240,23cyclictest0-21swapper/300:23:283
5213992424,0cyclictest0-21swapper/221:38:132
5213992423,1cyclictest271rcuc/221:55:062
5213992422,1cyclictest0-21swapper/223:54:172
5213992421,2cyclictest3490-21grep22:36:372
5213992421,2cyclictest14513-21/usr/sbin/munin00:11:332
5213992418,2cyclictest1496-21rm00:00:202
521399240,23cyclictest606-21dbus-daemon21:55:002
521399240,23cyclictest32056-21diskmemload21:15:242
521399240,23cyclictest23686-21lockfile-create00:20:002
521399240,23cyclictest0-21swapper/200:24:442
521399240,1cyclictest32056-21diskmemload21:20:362
521399240,1cyclictest0-21swapper/223:50:002
5211992424,0cyclictest0-21swapper/121:33:121
521199240,24cyclictest0-21swapper/121:18:361
521199240,23cyclictest17251-21latency_hist21:25:001
521199240,1cyclictest1881-21rm00:28:141
521199240,0cyclictest0-21swapper/123:59:441
5207992424,0cyclictest0-21swapper/022:40:190
5207992423,1cyclictest32056-21diskmemload23:42:270
5207992423,1cyclictest0-21swapper/023:18:000
5207992423,1cyclictest0-21swapper/021:15:180
5207992422,1cyclictest313-21systemd-journal20:00:010
5207992422,1cyclictest17782-21sh21:52:530
520799240,23cyclictest32056-21diskmemload22:21:410
520799240,23cyclictest14490-21munin-run20:35:000
520799240,22cyclictest18577-21ssh22:50:520
5218992323,0cyclictest0-21swapper/322:55:593
5218992323,0cyclictest0-21swapper/321:38:133
5218992323,0cyclictest0-21swapper/321:18:433
5218992323,0cyclictest0-21swapper/300:28:463
5218992323,0cyclictest0-21swapper/300:05:253
5218992322,1cyclictest34-21ksoftirqd/300:10:323
5218992322,1cyclictest0-21swapper/322:30:063
5218992322,1cyclictest0-21swapper/300:31:333
5218992321,1cyclictest14826-21perf19:30:003
521899230,2cyclictest5334-21munin-run21:15:003
521899230,23cyclictest0-21swapper/322:53:333
521899230,22cyclictest10517-21dump-pmu-power23:40:003
521899230,22cyclictest0-21swapper/323:06:343
521899230,22cyclictest0-21swapper/322:41:243
521899230,1cyclictest0-21swapper/323:54:373
521899230,1cyclictest0-21swapper/323:14:143
521899230,0cyclictest0-21swapper/323:02:083
521899230,0cyclictest0-21swapper/321:20:363
5213992323,0cyclictest0-21swapper/222:13:292
5213992323,0cyclictest0-21swapper/200:36:112
5213992323,0cyclictest0-21swapper/200:31:332
5213992323,0cyclictest0-21swapper/200:26:432
5213992321,1cyclictest21657-21cron20:50:012
5213992321,1cyclictest0-21swapper/222:45:212
5213992319,4cyclictest0-21swapper/223:08:062
521399230,2cyclictest10514-21idleruntime-cro23:40:002
521399230,23cyclictest32056-21diskmemload22:20:392
521399230,23cyclictest0-21swapper/222:55:592
521399230,23cyclictest0-21swapper/222:44:342
521399230,22cyclictest28067-21ls23:26:382
521399230,22cyclictest19468-21cut23:20:012
521399230,22cyclictest0-21swapper/223:12:162
521399230,22cyclictest0-21swapper/221:06:292
521399230,1cyclictest271rcuc/223:56:102
521399230,0cyclictest32056-21diskmemload22:53:332
521399230,0cyclictest32056-21diskmemload22:27:242
521399230,0cyclictest32056-21diskmemload21:41:402
521399230,0cyclictest0-21swapper/223:02:082
521399230,0cyclictest0-21swapper/222:31:282
521399230,0cyclictest0-21swapper/221:13:562
5211992323,0cyclictest3401-21ssh21:41:021
5211992323,0cyclictest0-21swapper/123:12:131
5211992323,0cyclictest0-21swapper/123:05:121
5211992323,0cyclictest0-21swapper/122:33:161
5211992323,0cyclictest0-21swapper/122:16:101
5211992323,0cyclictest0-21swapper/100:20:061
5211992323,0cyclictest0-21swapper/100:10:371
5211992323,0cyclictest0-21swapper/100:03:231
5211992321,2cyclictest9140-21ssh22:13:321
5211992321,1cyclictest32056-21diskmemload21:56:391
5211992321,1cyclictest18476-21sh21:25:561
5211992320,2cyclictest17581-21diskmemload23:17:341
521199230,23cyclictest0-21swapper/123:50:401
521199230,23cyclictest0-21swapper/122:35:261
521199230,22cyclictest857-21sh21:38:081
521199230,22cyclictest6751-21ssh22:40:161
521199230,22cyclictest29233-21perf20:00:011
521199230,22cyclictest27330-21ssh23:26:331
521199230,22cyclictest26496-21sed22:56:381
521199230,22cyclictest11191-21ssh00:08:261
521199230,22cyclictest11165-21needreboot00:36:341
521199230,22cyclictest0-21swapper/120:16:281
521199230,1cyclictest20256-21ssh23:20:501
521199230,0cyclictest0-21swapper/122:27:141
521199230,0cyclictest0-21swapper/122:05:121
5207992323,0cyclictest0-21swapper/023:52:420
5207992323,0cyclictest0-21swapper/023:45:450
5207992323,0cyclictest0-21swapper/023:36:290
5207992323,0cyclictest0-21swapper/022:55:190
5207992323,0cyclictest0-21swapper/022:35:230
5207992323,0cyclictest0-21swapper/021:42:290
5207992323,0cyclictest0-21swapper/000:26:560
5207992321,1cyclictest0-21swapper/021:20:020
5207992321,1cyclictest0-21swapper/000:30:180
5207992320,2cyclictest0-21swapper/000:11:030
520799230,2cyclictest30989-21sh22:32:160
520799230,23cyclictest0-21swapper/023:59:260
520799230,23cyclictest0-21swapper/022:28:150
520799230,23cyclictest0-21swapper/021:35:540
520799230,23cyclictest0-21swapper/000:06:070
520799230,22cyclictest8686-21rm21:45:330
520799230,22cyclictest32535-21sh22:06:260
520799230,22cyclictest13772-21ssh22:17:060
520799230,0cyclictest32056-21diskmemload23:08:340
520799230,0cyclictest32056-21diskmemload21:13:420
520799230,0cyclictest32056-21diskmemload00:35:270
520799230,0cyclictest0-21swapper/000:21:000
5218992222,0cyclictest0-21swapper/323:17:593
5218992222,0cyclictest0-21swapper/322:20:393
5218992222,0cyclictest0-21swapper/322:03:573
5218992222,0cyclictest0-21swapper/321:06:293
5218992222,0cyclictest0-21swapper/300:36:113
5218992220,1cyclictest0-21swapper/321:25:023
5218992220,1cyclictest0-21swapper/300:16:353
521899220,22cyclictest331rcuc/323:56:103
521899220,21cyclictest0-21swapper/321:30:463
521899220,21cyclictest0-21swapper/320:36:273
521899220,21cyclictest0-21swapper/300:00:213
521899220,1cyclictest32056-21diskmemload22:07:143
521899220,1cyclictest0-21swapper/320:46:293
521899220,0cyclictest0-21swapper/323:31:443
5213992222,0cyclictest0-21swapper/222:03:572
5213992220,1cyclictest19299-21idleruntime-cro20:45:012
5213992220,1cyclictest0-21swapper/222:05:382
521399221,20cyclictest606-21dbus-daemon20:00:012
521399221,20cyclictest271rcuc/222:16:102
521399220,22cyclictest0-21swapper/221:47:482
521399220,21cyclictest18267-21sh21:25:412
521399220,21cyclictest0-21swapper/223:31:132
521399220,21cyclictest0-21swapper/221:30:332
5211992222,0cyclictest0-21swapper/122:46:351
5211992222,0cyclictest0-21swapper/121:49:381
5211992220,2cyclictest16489-21ssh23:45:051
521199220,22cyclictest9346-21ssh23:38:251
521199220,22cyclictest14772-21sh23:42:581
521199220,22cyclictest0-21swapper/122:00:021
521199220,21cyclictest17267-21apt-get20:41:291
521199220,21cyclictest0-21swapper/121:51:151
521199220,1cyclictest4748-21ssh21:14:211
521199220,1cyclictest3432-21sh00:30:041
521199220,1cyclictest32056-21diskmemload22:54:361
521199220,1cyclictest22078-21ssh00:17:471
5207992222,0cyclictest0-21swapper/021:30:520
5207992222,0cyclictest0-21swapper/000:15:400
520799220,22cyclictest0-21swapper/023:21:370
520799220,21cyclictest4392-21cron20:15:000
520799220,21cyclictest32056-21diskmemload23:25:200
520799220,21cyclictest32056-21diskmemload22:45:230
520799220,21cyclictest32056-21diskmemload22:10:360
520799220,21cyclictest20332-21ssh21:55:220
520799220,21cyclictest0-21swapper/022:00:250
5218992119,1cyclictest19295-21turbostat20:45:013
5218992119,1cyclictest0-21swapper/320:55:023
521899210,20cyclictest0-21swapper/322:45:133
521899210,0cyclictest0-21swapper/320:06:283
5213992121,0cyclictest28-21ksoftirqd/219:24:592
5213992121,0cyclictest0-21swapper/219:15:442
5213992119,1cyclictest0-21swapper/220:55:012
521399210,20cyclictest0-21swapper/219:36:282
5211992121,0cyclictest20011-21apt-get19:41:271
5211992121,0cyclictest0-21swapper/119:26:291
5211992120,1cyclictest15203-21apt-get19:31:281
5211992120,0cyclictest19660-21apt-get20:46:291
521199210,21cyclictest0-21swapper/120:30:021
521199210,20cyclictest31624-21cron20:05:011
521199210,20cyclictest14846-21apt-get20:36:271
5207992121,0cyclictest0-21swapper/023:01:040
5207992121,0cyclictest0-21swapper/020:06:280
5207992120,1cyclictest24443-21perf19:50:010
5207992120,1cyclictest10410-21apt-get19:21:290
520799210,20cyclictest21685-21turbostat.cron20:50:010
5218992020,0cyclictest0-21swapper/320:30:023
5218992020,0cyclictest0-21swapper/319:24:593
5218992020,0cyclictest0-21swapper/319:14:133
5218992018,1cyclictest24069-21apt-get20:55:013
521899200,20cyclictest0-21swapper/320:26:283
5213992020,0cyclictest0-21swapper/220:55:022
5213992020,0cyclictest0-21swapper/220:21:292
5213992020,0cyclictest0-21swapper/220:16:282
5213992020,0cyclictest0-21swapper/220:11:292
5213992020,0cyclictest0-21swapper/219:26:292
5213992019,0cyclictest24799-21apt-get19:51:282
5213992019,0cyclictest24799-21apt-get19:51:282
5213992018,1cyclictest0-21swapper/221:05:002
521399200,20cyclictest0-21swapper/220:36:272
5211992020,0cyclictest0-21swapper/119:36:281
5207992020,0cyclictest0-21swapper/020:41:280
5207992019,0cyclictest0-21swapper/020:26:280
520799200,0cyclictest0-21swapper/021:06:290
5218991919,0cyclictest0-21swapper/320:21:293
5218991919,0cyclictest0-21swapper/320:11:293
5218991919,0cyclictest0-21swapper/319:36:283
5218991917,1cyclictest29274-21apt-get21:05:003
5213991919,0cyclictest0-21swapper/219:31:282
5211991919,0cyclictest27263-21apt-get21:01:291
5211991919,0cyclictest0-21swapper/119:51:281
5211991919,0cyclictest0-21swapper/119:51:281
5207991919,0cyclictest0-21swapper/019:36:280
5207991919,0cyclictest0-21swapper/019:31:280
5207991919,0cyclictest0-21swapper/019:26:290
520799190,19cyclictest0-21swapper/019:51:280
520799190,19cyclictest0-21swapper/019:51:280
5218991818,0cyclictest0-21swapper/320:16:283
5218991818,0cyclictest0-21swapper/319:51:283
5218991818,0cyclictest0-21swapper/319:51:283
5218991816,1cyclictest27195-21apt-get19:56:273
521899180,16cyclictest34-21ksoftirqd/319:16:353
5213991818,0cyclictest0-21swapper/219:11:272
5211991818,0cyclictest32008-21apt-get20:06:281
5211991818,0cyclictest0-21swapper/121:06:291
5211991818,0cyclictest0-21swapper/120:21:291
5211991818,0cyclictest0-21swapper/119:46:261
5207991818,0cyclictest0-21swapper/021:01:290
5207991818,0cyclictest0-21swapper/020:55:020
5207991818,0cyclictest0-21swapper/020:01:290
5207991817,1cyclictest5540-21apt-get19:11:270
521899171,13cyclictest34-21ksoftirqd/319:31:283
521899170,16cyclictest0-21swapper/320:05:013
5211991717,0cyclictest24069-21apt-get20:55:021
5211991717,0cyclictest0-21swapper/120:51:291
5211991717,0cyclictest0-21swapper/120:10:021
5211991717,0cyclictest0-21swapper/119:11:271
5207991717,0cyclictest7267-21apt-get20:21:290
5207991717,0cyclictest4783-21apt-get20:16:280
5207991717,0cyclictest0-21swapper/020:36:280
5207991717,0cyclictest0-21swapper/019:41:280
5213991614,1cyclictest30047-21forks20:01:312
521199160,15cyclictest9658-21apt-get20:26:281
5213991515,0cyclictest0-21swapper/220:06:282
5207991515,0cyclictest0-21swapper/020:51:280
521899140,14cyclictest0-21swapper/319:40:013
521899140,0cyclictest0-21swapper/319:45:303
5213991414,0cyclictest0-21swapper/219:45:342
5213991414,0cyclictest0-21swapper/219:40:392
521399140,14cyclictest0-21swapper/220:30:322
521399140,0cyclictest0-21swapper/220:26:262
5211991414,0cyclictest0-21swapper/119:15:391
520799140,14cyclictest0-21swapper/019:15:490
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional