You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 06:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue May 05, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27937992521,1cyclictest14281-21munin-run22:30:003
27936992523,1cyclictest0-21swapper/200:20:012
2793699250,24cyclictest0-21swapper/222:11:032
2793599250,1cyclictest0-21swapper/122:02:001
2793499250,24cyclictest30400-21sh00:36:450
2793799240,24cyclictest0-21swapper/322:40:453
2793799240,23cyclictest21152-21diskmemload23:15:273
2793799240,23cyclictest19630-21sh00:27:313
2793799240,23cyclictest18419-21irqstats23:01:253
2793799240,23cyclictest0-21swapper/321:13:263
2793799240,1cyclictest28830-21ssh23:39:403
2793699240,23cyclictest21152-21diskmemload22:17:082
2793699240,23cyclictest0-21swapper/223:23:192
2793699240,23cyclictest0-21swapper/223:11:192
2793699240,23cyclictest0-21swapper/222:41:082
2793699240,23cyclictest0-21swapper/200:15:492
27935992422,1cyclictest22506-21sendmail21:40:001
27935992422,1cyclictest0-21swapper/123:01:211
27935992422,1cyclictest0-21swapper/122:53:301
27935992421,2cyclictest20415-21sensors_temp23:31:261
2793599240,23cyclictest5796-21ssh23:46:301
2793599240,23cyclictest0-21swapper/100:28:071
27934992424,0cyclictest0-21swapper/022:49:300
27934992423,1cyclictest0-21swapper/022:08:310
27934992421,2cyclictest16296-21rm22:02:170
27934992420,4cyclictest0-21swapper/023:46:180
2793499240,24cyclictest0-21swapper/000:14:000
2793499240,23cyclictest2202-21ssh22:19:120
2793499240,1cyclictest21159-21sh21:10:000
2793499240,0cyclictest0-21swapper/021:56:190
27937992323,0cyclictest0-21swapper/323:45:043
27937992323,0cyclictest0-21swapper/321:52:283
27937992323,0cyclictest0-21swapper/300:01:043
27937992322,1cyclictest18395-21ssh23:58:223
27937992321,1cyclictest0-21swapper/321:40:523
2793799230,23cyclictest21152-21diskmemload22:51:133
2793799230,23cyclictest0-21swapper/323:31:323
2793799230,22cyclictest5112-21perf19:30:003
2793799230,22cyclictest31524-21sh21:46:563
2793799230,22cyclictest25836-21ssh23:07:303
2793799230,22cyclictest17207-21rm22:03:343
2793799230,22cyclictest10988-21rm22:55:053
2793799230,0cyclictest0-21swapper/300:35:173
2793799230,0cyclictest0-21swapper/300:15:343
27936992323,0cyclictest21152-21diskmemload21:52:342
27936992323,0cyclictest0-21swapper/223:54:302
27936992323,0cyclictest0-21swapper/200:26:012
27936992323,0cyclictest0-21swapper/200:13:202
27936992322,1cyclictest21152-21diskmemload23:39:452
27936992322,1cyclictest0-21swapper/222:24:212
27936992321,1cyclictest16741-21apt-get21:01:222
27936992321,1cyclictest15720-21diskstats22:31:192
27936992321,1cyclictest0-21swapper/223:02:552
27936992321,1cyclictest0-21swapper/200:35:102
27936992321,1cyclictest0-21swapper/200:06:112
27936992320,2cyclictest606-21dbus-daemon20:05:002
2793699230,2cyclictest0-21swapper/221:46:292
2793699230,23cyclictest21152-21diskmemload22:02:102
2793699230,23cyclictest0-21swapper/223:40:542
2793699230,23cyclictest0-21swapper/221:19:332
2793699230,23cyclictest0-21swapper/200:01:292
2793699230,22cyclictest5947-21rm22:50:552
2793699230,22cyclictest0-21swapper/223:56:322
2793699230,22cyclictest0-21swapper/223:30:202
2793699230,1cyclictest0-21swapper/221:30:572
2793699230,0cyclictest21152-21diskmemload21:21:202
2793699230,0cyclictest0-21swapper/223:05:402
2793699230,0cyclictest0-21swapper/222:07:402
2793699230,0cyclictest0-21swapper/221:26:192
2793699230,0cyclictest0-21swapper/221:11:292
27935992323,0cyclictest0-21swapper/122:45:381
27935992323,0cyclictest0-21swapper/122:31:211
27935992323,0cyclictest0-21swapper/100:35:201
27935992323,0cyclictest0-21swapper/100:23:211
27935992322,1cyclictest0-21swapper/123:21:501
27935992322,1cyclictest0-21swapper/123:13:171
27935992321,1cyclictest8602-21df21:56:211
27935992321,1cyclictest19131-21apt-get21:06:181
27935992321,1cyclictest0-21swapper/122:16:191
27935992321,1cyclictest0-21swapper/121:47:181
27935992320,2cyclictest11025-21ssh22:55:081
2793599230,23cyclictest21152-21diskmemload23:54:391
2793599230,23cyclictest0-21swapper/123:41:121
2793599230,23cyclictest0-21swapper/123:25:131
2793599230,23cyclictest0-21swapper/122:25:071
2793599230,23cyclictest0-21swapper/122:11:321
2793599230,23cyclictest0-21swapper/121:30:411
2793599230,23cyclictest0-21swapper/121:17:451
2793599230,22cyclictest3799-21sh22:21:011
2793599230,22cyclictest22597-21ptp4l22:36:241
2793599230,22cyclictest22398-21sh00:30:551
2793599230,22cyclictest22318-21apt-get21:11:191
2793599230,22cyclictest1565-21basename20:30:011
2793599230,22cyclictest0-21swapper/121:51:401
2793599230,1cyclictest0-21swapper/121:42:391
2793599230,0cyclictest0-21swapper/123:56:171
2793599230,0cyclictest0-21swapper/123:08:191
2793599230,0cyclictest0-21swapper/100:14:431
2793599230,0cyclictest0-21swapper/100:01:021
27934992323,0cyclictest21152-21diskmemload23:30:250
27934992323,0cyclictest21152-21diskmemload21:37:250
27934992323,0cyclictest1810-21ssh23:15:590
27934992323,0cyclictest0-21swapper/023:50:470
27934992323,0cyclictest0-21swapper/023:26:090
27934992323,0cyclictest0-21swapper/022:11:100
27934992323,0cyclictest0-21swapper/021:23:030
27934992322,1cyclictest26857-21ssh21:43:060
27934992321,2cyclictest16341-21cron23:00:010
27934992321,1cyclictest19499-21sendmail20:00:010
27934992320,2cyclictest16376-21perf21:00:000
2793499230,23cyclictest21152-21diskmemload21:10:310
2793499230,23cyclictest21152-21diskmemload00:33:560
2793499230,23cyclictest0-21swapper/022:50:260
2793499230,22cyclictest6745-21sh21:26:180
2793499230,22cyclictest31258-21sh21:46:290
2793499230,22cyclictest2720-21awk19:25:000
2793499230,22cyclictest16015-21ssh21:33:490
2793499230,22cyclictest0-21swapper/021:18:030
2793499230,0cyclictest21152-21diskmemload22:27:420
2793499230,0cyclictest21152-21diskmemload00:27:490
2793499230,0cyclictest0-21swapper/023:43:500
2793499230,0cyclictest0-21swapper/023:20:040
2793499230,0cyclictest0-21swapper/022:38:400
27937992222,0cyclictest0-21swapper/323:50:563
27937992222,0cyclictest0-21swapper/323:40:473
27937992222,0cyclictest0-21swapper/300:14:593
27937992221,1cyclictest21152-21diskmemload00:08:303
27937992221,1cyclictest17836-21rm21:35:583
27937992220,1cyclictest29548-21apt-get20:21:183
27937992220,1cyclictest0-21swapper/322:35:253
27937992220,1cyclictest0-21swapper/321:00:003
2793799220,22cyclictest21152-21diskmemload23:27:103
2793799220,22cyclictest0-21swapper/322:31:513
2793799220,22cyclictest0-21swapper/321:29:443
2793799220,22cyclictest0-21swapper/321:21:233
2793799220,22cyclictest0-21swapper/300:32:473
2793799220,21cyclictest5965-21sh22:21:323
2793799220,21cyclictest32699-21rm22:45:523
2793799220,21cyclictest21152-21diskmemload22:10:073
2793799220,21cyclictest11549-21idleruntime-cro20:50:013
2793799220,21cyclictest10436-21sh00:20:053
2793799220,1cyclictest31448-21sh23:12:313
2793799220,1cyclictest11525-21rm21:30:043
2793799220,1cyclictest0-21swapper/322:15:053
2793799220,1cyclictest0-21swapper/322:06:123
27936992222,0cyclictest21152-21diskmemload22:47:052
27936992220,1cyclictest0-21swapper/222:56:202
27936992220,1cyclictest0-21swapper/222:35:272
27936992220,1cyclictest0-21swapper/221:35:332
27936992220,1cyclictest0-21swapper/220:15:002
2793699220,22cyclictest0-21swapper/223:27:572
2793699220,21cyclictest9927-21perf19:40:012
2793699220,21cyclictest31592-21apt20:25:002
2793699220,21cyclictest21152-21diskmemload23:15:202
2793699220,21cyclictest21152-21diskmemload22:25:032
2793699220,21cyclictest0-21swapper/223:45:222
2793699220,21cyclictest0-21swapper/221:56:202
2793699220,1cyclictest0-21swapper/221:41:222
2793699220,0cyclictest0-21swapper/200:34:092
27935992222,0cyclictest0-21swapper/123:37:081
27935992222,0cyclictest0-21swapper/100:09:231
27935992220,1cyclictest9188-21munin-plugin-st20:45:011
27935992220,1cyclictest0-21swapper/100:15:071
2793599220,21cyclictest649-21apt-get19:21:181
2793599220,21cyclictest15070-21apt-get19:51:181
2793599220,21cyclictest0-21swapper/123:15:491
2793599220,21cyclictest0-21swapper/122:40:301
2793599220,1cyclictest0-21swapper/121:20:571
27934992222,0cyclictest0-21swapper/023:06:420
27934992222,0cyclictest0-21swapper/000:09:180
2793499220,22cyclictest21152-21diskmemload23:01:300
2793499220,22cyclictest15052-21sh22:31:020
2793499220,22cyclictest0-21swapper/022:40:240
2793499220,21cyclictest619-21polkitd20:40:010
2793499220,21cyclictest0-21swapper/023:10:360
2793499220,1cyclictest27015-21ssh23:37:130
2793499220,1cyclictest1658-21rm21:50:040
2793499220,1cyclictest0-21swapper/000:15:020
2793499220,0cyclictest0-21swapper/023:56:260
2793499220,0cyclictest0-21swapper/022:22:430
2793499220,0cyclictest0-21swapper/000:20:170
2793799210,1cyclictest0-21swapper/320:20:003
2793799210,0cyclictest28277-21apt-get19:11:193
2793799210,0cyclictest0-21swapper/321:55:113
27936992120,1cyclictest5473-21apt-get19:31:192
27936992119,1cyclictest13980-21munin-run20:55:002
27936992119,1cyclictest0-21swapper/220:45:012
2793699210,20cyclictest4720-21apt-get20:36:182
2793699210,1cyclictest32737-21cat19:20:002
2793699210,1cyclictest16387-21munin-run21:00:002
27935992120,1cyclictest3071-21apt-get19:26:181
27935992119,1cyclictest313-21systemd-journal19:35:001
2793599210,21cyclictest0-21swapper/120:01:191
2793599210,0cyclictest0-21swapper/121:26:201
27934992121,0cyclictest22278-21apt-get20:06:180
27934992120,1cyclictest622-21gdbus20:50:010
27934992120,0cyclictest0-21swapper/020:21:180
27934992119,1cyclictest32735-21perf19:20:000
2793499210,20cyclictest27120-21apt-get20:16:180
27936992020,0cyclictest0-21swapper/220:46:202
27936992019,0cyclictest0-21swapper/220:16:182
2793699200,0cyclictest0-21swapper/219:46:192
27935992020,0cyclictest0-21swapper/119:46:191
27935992018,1cyclictest607-21in:imuxsock19:20:001
2793599200,0cyclictest0-21swapper/120:16:181
2793599200,0cyclictest0-21swapper/120:06:181
27934992020,0cyclictest2321-21apt-get20:31:180
27934992019,1cyclictest0-21swapper/021:01:220
2793499200,20cyclictest0-21swapper/020:01:190
27937991919,0cyclictest0-21swapper/319:16:193
27937991916,3cyclictest11924-21apt-get20:51:193
27936991919,0cyclictest0-21swapper/219:56:192
27935991919,0cyclictest17468-21apt-get19:56:191
27935991919,0cyclictest0-21swapper/120:11:191
27935991918,1cyclictest0-21swapper/120:30:021
27934991919,0cyclictest0-21swapper/019:46:190
27937991818,0cyclictest10281-21apt-get19:41:183
27937991818,0cyclictest10281-21apt-get19:41:183
27937991818,0cyclictest0-21swapper/320:11:193
27937991818,0cyclictest0-21swapper/320:06:183
27937991818,0cyclictest0-21swapper/320:01:193
27935991818,0cyclictest0-21swapper/120:51:191
27935991818,0cyclictest0-21swapper/120:36:181
27935991818,0cyclictest0-21swapper/119:41:181
27935991818,0cyclictest0-21swapper/119:41:181
27935991818,0cyclictest0-21swapper/119:36:171
27934991816,1cyclictest26761-21latency_hist20:15:000
27934991813,4cyclictest783-21snmpd19:51:190
27937991717,0cyclictest0-21swapper/319:31:183
27936991717,0cyclictest31941-21apt-get20:26:182
27935991717,0cyclictest0-21swapper/119:15:001
27935991715,1cyclictest0-21swapper/120:21:181
27934991717,0cyclictest0-21swapper/020:41:190
27934991717,0cyclictest0-21swapper/019:40:010
27937991614,1cyclictest14712-21ls19:50:013
2793699160,15cyclictest0-21swapper/219:28:282
27935991616,0cyclictest0-21swapper/120:56:191
2793599160,15cyclictest0-21swapper/120:50:011
27934991616,0cyclictest0-21swapper/020:51:190
27937991515,0cyclictest7138-21apt-get20:41:193
2793799150,14cyclictest17789-21ntp_states21:01:273
27936991515,0cyclictest0-21swapper/221:06:182
27936991515,0cyclictest0-21swapper/220:06:172
27936991515,0cyclictest0-21swapper/219:51:182
27934991515,0cyclictest0-21swapper/019:31:190
27937991414,0cyclictest1556-21apt-get20:30:023
27937991414,0cyclictest0-21swapper/321:05:073
27937991414,0cyclictest0-21swapper/320:26:023
27937991414,0cyclictest0-21swapper/319:35:133
27937991414,0cyclictest0-21swapper/319:21:053
2793799140,14cyclictest0-21swapper/320:35:113
2793799140,14cyclictest0-21swapper/319:50:583
2793799140,0cyclictest0-21swapper/319:55:093
27936991414,0cyclictest0-21swapper/220:30:222
2793699140,14cyclictest0-21swapper/219:40:112
2793699140,14cyclictest0-21swapper/219:40:112
2793699140,14cyclictest0-21swapper/219:20:132
2793699140,0cyclictest0-21swapper/219:11:322
2793599140,14cyclictest0-21swapper/121:00:311
27934991414,0cyclictest0-21swapper/019:10:590
2793499140,14cyclictest0-21swapper/019:40:460
2793499140,14cyclictest0-21swapper/019:40:460
2793499140,14cyclictest0-21swapper/019:25:450
2793499140,0cyclictest0-21swapper/020:25:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional