You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-05 - 15:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Aug 05, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
554799261,24cyclictest331rcuc/321:53:543
554499260,3cyclictest0-21swapper/100:03:351
554599250,1cyclictest0-21swapper/221:54:382
554599250,1cyclictest0-21swapper/200:14:042
554499250,24cyclictest32049-21diskmemload23:58:351
554499250,24cyclictest32049-21diskmemload23:09:271
554499250,24cyclictest0-21swapper/123:31:081
554499250,24cyclictest0-21swapper/121:22:221
5543992523,1cyclictest0-21swapper/022:49:560
554399250,24cyclictest32049-21diskmemload23:59:500
554399250,24cyclictest32049-21diskmemload00:38:230
554399250,24cyclictest32049-21diskmemload00:10:190
554399250,1cyclictest0-21swapper/023:41:330
554799243,1cyclictest34-21ksoftirqd/323:01:333
554799240,24cyclictest0-21swapper/321:43:353
554799240,24cyclictest0-21swapper/300:16:293
554799240,24cyclictest0-21swapper/300:16:293
554799240,23cyclictest32049-21diskmemload21:30:383
554799240,23cyclictest32049-21diskmemload00:03:403
554799240,23cyclictest17362-21ssh22:52:093
554799240,23cyclictest0-21swapper/321:24:063
554799240,23cyclictest0-21swapper/300:12:503
554799240,1cyclictest32049-21diskmemload21:48:453
554799240,1cyclictest0-21swapper/322:33:323
554799240,0cyclictest32049-21diskmemload22:57:243
5545992423,1cyclictest32049-21diskmemload23:20:212
5545992422,1cyclictest32049-21diskmemload23:01:312
5545992422,1cyclictest24096-21ssh22:58:482
554599240,24cyclictest32049-21diskmemload22:45:522
554599240,23cyclictest0-21swapper/221:17:222
554599240,1cyclictest0-21swapper/222:01:132
5544992423,1cyclictest32049-21diskmemload23:37:001
554499240,24cyclictest0-21swapper/122:26:311
554499240,24cyclictest0-21swapper/100:26:571
554499240,23cyclictest7419-21ssh23:40:171
554499240,23cyclictest0-21swapper/121:43:151
554499240,23cyclictest0-21swapper/100:30:141
554499240,0cyclictest0-21swapper/100:05:391
5543992423,1cyclictest32049-21diskmemload23:05:360
554399240,24cyclictest32049-21diskmemload21:35:510
554399240,24cyclictest0-21swapper/022:21:350
554399240,24cyclictest0-21swapper/000:29:440
554399240,23cyclictest32049-21diskmemload23:54:010
554399240,23cyclictest25227-21awk22:30:000
554399240,23cyclictest0-21swapper/023:31:370
554399240,0cyclictest32049-21diskmemload21:40:380
5547992323,0cyclictest0-21swapper/323:18:303
5547992323,0cyclictest0-21swapper/300:26:453
5547992321,1cyclictest18874-21ssh21:27:323
5547992320,2cyclictest30120-21ssh23:32:233
554799231,1cyclictest34-21ksoftirqd/320:43:583
554799230,23cyclictest0-21swapper/323:24:453
554799230,23cyclictest0-21swapper/323:13:523
554799230,23cyclictest0-21swapper/321:19:363
554799230,23cyclictest0-21swapper/300:39:023
554799230,22cyclictest7414-21ssh23:40:163
554799230,22cyclictest3763-21ssh23:38:083
554799230,0cyclictest32049-21diskmemload23:54:593
5545992323,0cyclictest0-21swapper/222:44:562
5545992323,0cyclictest0-21swapper/222:31:022
5545992323,0cyclictest0-21swapper/200:39:412
5545992322,1cyclictest0-21swapper/200:20:412
5545992320,2cyclictest3822-21rm00:34:542
5545992320,2cyclictest21047-21sh21:58:432
5545992320,2cyclictest0-21swapper/223:47:072
554599230,2cyclictest3812-21perf22:40:002
554599230,23cyclictest32049-21diskmemload23:35:092
554599230,23cyclictest32049-21diskmemload22:15:402
554599230,22cyclictest912-21diskmemload22:09:022
554599230,22cyclictest0-21swapper/222:27:362
554599230,21cyclictest0-21swapper/221:32:382
554599230,0cyclictest32049-21diskmemload00:08:042
554599230,0cyclictest0-21swapper/223:54:422
554599230,0cyclictest0-21swapper/223:11:222
554599230,0cyclictest0-21swapper/222:22:372
554599230,0cyclictest0-21swapper/221:39:442
554599230,0cyclictest0-21swapper/200:26:012
5544992323,0cyclictest0-21swapper/122:30:041
5544992323,0cyclictest0-21swapper/121:49:301
5544992322,1cyclictest32049-21diskmemload22:10:081
5544992322,1cyclictest32049-21diskmemload21:55:321
5544992321,1cyclictest30571-21ssh22:06:261
5544992320,2cyclictest8317-21rm22:15:011
554499230,2cyclictest5203-21apt20:15:001
554499230,2cyclictest12923-21ssh23:17:051
554499230,23cyclictest0-21swapper/121:35:181
554499230,22cyclictest6924-21ssh22:43:521
554499230,22cyclictest32049-21diskmemload22:22:301
554499230,22cyclictest22460-21turbostat.cron20:50:001
554499230,22cyclictest17719-21ssh23:49:201
554499230,22cyclictest0-21swapper/123:21:031
554499230,22cyclictest0-21swapper/121:31:231
554499230,1cyclictest0-21swapper/123:10:371
554499230,0cyclictest0-21swapper/123:01:161
554499230,0cyclictest0-21swapper/121:14:341
554499230,0cyclictest0-21swapper/100:20:411
5543992323,0cyclictest0-21swapper/022:56:020
5543992323,0cyclictest0-21swapper/022:36:110
5543992323,0cyclictest0-21swapper/021:25:150
5543992323,0cyclictest0-21swapper/021:10:220
5543992323,0cyclictest0-21swapper/000:34:370
5543992323,0cyclictest0-21swapper/000:07:300
5543992322,1cyclictest62550irq/127-eno123:24:360
5543992322,1cyclictest0-21swapper/021:58:360
5543992321,1cyclictest6005-21sh21:15:150
5543992321,1cyclictest0-21swapper/023:03:520
5543992321,1cyclictest0-21swapper/022:06:550
554399230,23cyclictest0-21swapper/022:51:210
554399230,23cyclictest0-21swapper/022:10:260
554399230,23cyclictest0-21swapper/021:48:020
554399230,23cyclictest0-21swapper/000:19:180
554399230,23cyclictest0-21swapper/000:19:180
554399230,22cyclictest4672-21ssh22:40:480
554399230,22cyclictest3143-21runrttasks23:37:090
554399230,22cyclictest24456-21sh21:32:260
554399230,22cyclictest23529-21ssh23:26:090
554399230,22cyclictest0-21swapper/023:19:060
554399230,22cyclictest0-21swapper/023:10:580
554399230,0cyclictest0-21swapper/022:04:590
5547992222,0cyclictest0-21swapper/322:10:033
5547992220,1cyclictest31935-21sh22:36:343
5547992220,1cyclictest29426-40mandb00:00:003
5547992220,1cyclictest0-21swapper/320:03:563
554799221,20cyclictest3362-21apt-get20:13:563
554799220,2cyclictest15258-21sh20:35:013
554799220,22cyclictest0-21swapper/321:38:583
554799220,21cyclictest32049-21diskmemload23:45:483
554799220,21cyclictest32049-21diskmemload22:18:253
554799220,21cyclictest29683-21sh22:05:193
554799220,21cyclictest0-21swapper/323:26:263
554799220,21cyclictest0-21swapper/323:05:473
554799220,21cyclictest0-21swapper/322:40:133
554799220,21cyclictest0-21swapper/322:00:433
554799220,21cyclictest0-21swapper/300:30:343
554799220,1cyclictest536-21ssh21:10:513
554799220,1cyclictest0-21swapper/300:05:303
554799220,0cyclictest0-21swapper/300:23:183
5545992222,0cyclictest32049-21diskmemload23:32:142
5545992222,0cyclictest0-21swapper/223:55:382
5545992222,0cyclictest0-21swapper/223:26:242
5545992222,0cyclictest0-21swapper/223:15:542
5545992220,1cyclictest0-21swapper/223:05:092
5545992220,1cyclictest0-21swapper/222:11:372
554599220,21cyclictest7761-21ssh21:45:512
554599220,21cyclictest32379-21ssh21:10:062
554599220,21cyclictest16576-21sh22:51:092
554599220,21cyclictest0-21swapper/221:25:422
554599220,21cyclictest0-21swapper/221:20:142
554599220,21cyclictest0-21swapper/220:03:562
554599220,21cyclictest0-21swapper/219:13:552
5544992222,0cyclictest0-21swapper/123:25:081
5544992222,0cyclictest0-21swapper/122:38:181
5544992221,1cyclictest22127-21ssh23:53:591
5544992220,2cyclictest15778-21apt-get22:50:021
5544992220,1cyclictest0-21swapper/122:00:031
5544992219,2cyclictest7487-21ssh21:17:151
554499220,22cyclictest19681-21ssh21:28:331
554499220,21cyclictest9886-21ssh22:45:151
554499220,21cyclictest7894-21idleruntime-cro19:15:001
554499220,21cyclictest25424-21apt-get20:58:581
554499220,21cyclictest0-21swapper/121:50:211
554499220,1cyclictest5203-21apt-get20:15:021
554499220,1cyclictest26126-21apt-get19:53:561
554499220,1cyclictest0-21swapper/120:45:011
554499220,0cyclictest0-21swapper/100:11:121
5543992222,0cyclictest0-21swapper/000:01:090
5543992220,1cyclictest0-21swapper/021:50:010
5543992220,1cyclictest0-21swapper/020:28:560
5543992219,2cyclictest606-21dbus-daemon19:50:010
554399220,22cyclictest0-21swapper/000:24:050
554399220,21cyclictest23031-21apt-get20:53:580
554399220,21cyclictest0-21swapper/020:18:550
554399220,1cyclictest32049-21diskmemload22:32:150
554399220,1cyclictest32049-21diskmemload21:22:020
554399220,1cyclictest22475-21awk20:50:000
554399220,1cyclictest12863-21ssh23:45:040
5547992120,1cyclictest0-21swapper/319:48:563
5547992119,1cyclictest0-21swapper/322:25:333
554799211,1cyclictest151rcu_preempt19:34:013
554799210,21cyclictest0-21swapper/319:13:563
554799210,1cyclictest0-21swapper/320:15:023
554799210,0cyclictest0-21swapper/320:28:563
554799210,0cyclictest0-21swapper/319:23:583
5545992121,0cyclictest0-21swapper/221:40:162
5545992121,0cyclictest0-21swapper/219:23:582
5545992120,1cyclictest0-21swapper/219:28:572
5545992120,0cyclictest954-21apt-get20:08:552
554599210,21cyclictest0-21swapper/200:00:022
554599210,20cyclictest8467-21apt-get19:18:572
554599210,20cyclictest15820-21apt-get20:38:562
554599210,20cyclictest10973-21apt-get20:28:562
554599210,20cyclictest0-21swapper/221:03:572
554599210,0cyclictest0-21swapper/223:40:232
554499210,20cyclictest30233-21apt-get21:08:581
554499210,0cyclictest0-21swapper/122:55:031
554499210,0cyclictest0-21swapper/100:35:151
5543992121,0cyclictest0-21swapper/019:33:560
5543992119,1cyclictest0-21swapper/019:45:010
554399210,20cyclictest0-21swapper/020:08:550
554399210,20cyclictest0-21swapper/019:20:000
554399210,0cyclictest0-21swapper/021:08:580
5547992020,0cyclictest0-21swapper/321:03:573
5547992020,0cyclictest0-21swapper/319:43:573
5547992020,0cyclictest0-21swapper/319:18:573
5545992020,0cyclictest0-21swapper/221:08:582
5544992020,0cyclictest0-21swapper/121:03:571
5544992020,0cyclictest0-21swapper/119:58:551
5544992018,1cyclictest0-21swapper/120:03:561
5544992017,2cyclictest10306-21cron19:20:001
554499200,0cyclictest0-21swapper/120:33:561
5543992020,0cyclictest0-21swapper/019:28:560
554399200,0cyclictest0-21swapper/020:13:560
5545991919,0cyclictest0-21swapper/220:43:582
5545991917,1cyclictest25569-21grep19:50:012
5544991919,0cyclictest0-21swapper/120:53:581
5544991918,1cyclictest18917-21apt-get19:38:561
5543991918,0cyclictest30954-21apt-get20:03:560
5545991818,0cyclictest0-21swapper/220:13:562
5545991817,1cyclictest6162-21apt-get20:18:552
5543991818,0cyclictest0-21swapper/020:38:560
5543991817,1cyclictest28517-21apt-get19:58:560
5543991816,1cyclictest0-21swapper/019:35:020
5545991716,1cyclictest21334-21apt-get19:43:582
5545991716,1cyclictest0-21swapper/219:38:552
5544991717,0cyclictest0-21swapper/120:28:561
5544991715,1cyclictest23725-21apt-get19:48:561
5544991715,1cyclictest0-21swapper/119:28:571
5543991714,1cyclictest313-21systemd-journal19:25:000
5547991616,0cyclictest0-21swapper/319:28:563
5547991614,1cyclictest27255-21tr21:00:003
554799161,14cyclictest34-21ksoftirqd/320:48:533
554599165,10cyclictest16126-21apt-get19:33:562
5545991614,1cyclictest24037-21cut20:54:022
5544991616,0cyclictest0-21swapper/120:08:561
5544991614,1cyclictest22381-21ntp_states19:44:031
5544991614,1cyclictest10886-21apt-get19:23:571
554499160,15cyclictest10413-21latency_hist20:25:001
5543991615,1cyclictest0-21swapper/020:43:580
554799152,12cyclictest783-21snmpd21:06:243
5547991515,0cyclictest0-21swapper/320:23:543
5547991514,1cyclictest34-21ksoftirqd/320:40:013
5547991514,0cyclictest0-21swapper/319:35:023
5547991510,4cyclictest34-21ksoftirqd/320:08:573
5545991515,0cyclictest0-21swapper/220:58:582
554599150,14cyclictest0-21swapper/219:59:362
5543991514,1cyclictest0-21swapper/020:58:580
5547991414,0cyclictest0-21swapper/319:58:003
554799140,0cyclictest0-21swapper/319:52:053
5545991414,0cyclictest0-21swapper/220:48:182
5545991414,0cyclictest0-21swapper/219:53:562
554599140,14cyclictest0-21swapper/220:33:322
554599140,0cyclictest0-21swapper/220:22:102
554499140,14cyclictest0-21swapper/119:30:431
554399140,14cyclictest0-21swapper/020:31:130
554399140,14cyclictest0-21swapper/019:10:120
554399140,0cyclictest0-21swapper/021:01:040
5547991313,0cyclictest0-21swapper/320:51:293
5543991313,0cyclictest0-21swapper/019:50:310
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional