You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 16:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Jul 25, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3094499293,25cyclictest622-21gdbus09:05:013
3094499250,24cyclictest5617-21ssh11:45:403
30941992523,1cyclictest9135-21apt-get08:38:052
30941992520,4cyclictest0-21swapper/210:58:012
3094199250,1cyclictest25480-21diskmemload11:09:312
3093899250,25cyclictest0-21swapper/111:18:271
3093899250,1cyclictest0-21swapper/110:50:011
3093499250,24cyclictest62550irq/127-eno112:12:560
3093499250,24cyclictest25480-21diskmemload09:58:110
3094499240,1cyclictest21101-21ssh09:34:253
3094199240,24cyclictest0-21swapper/211:16:022
3094199240,24cyclictest0-21swapper/209:45:132
3094199240,23cyclictest0-21swapper/209:27:562
30938992423,0cyclictest0-21swapper/112:12:291
3093899241,22cyclictest19340-21sh10:59:191
3093899240,24cyclictest0-21swapper/112:36:321
3093899240,24cyclictest0-21swapper/111:11:291
3093899240,23cyclictest9678-21/usr/sbin/munin09:53:131
3093899240,23cyclictest25480-21diskmemload11:59:561
3093899240,23cyclictest25480-21diskmemload09:57:021
3093899240,23cyclictest0-21swapper/111:32:511
3093899240,23cyclictest0-21swapper/111:26:291
3093899240,23cyclictest0-21swapper/110:23:441
3093899240,1cyclictest0-21swapper/111:38:151
30934992424,0cyclictest0-21swapper/012:39:580
3093499240,24cyclictest0-21swapper/011:39:110
3093499240,24cyclictest0-21swapper/009:44:100
3093499240,24cyclictest0-21swapper/009:18:190
3093499240,23cyclictest0-21swapper/011:02:460
3093499240,1cyclictest24648-21ssh12:31:160
3093499240,1cyclictest0-21swapper/011:51:380
3093499240,0cyclictest0-21swapper/011:25:280
30944992323,0cyclictest25480-21diskmemload10:46:363
30944992323,0cyclictest25480-21diskmemload10:37:433
30944992323,0cyclictest0-21swapper/312:33:433
30944992323,0cyclictest0-21swapper/312:24:183
30944992323,0cyclictest0-21swapper/311:03:473
3094499230,2cyclictest21265-21ssh12:28:103
3094499230,23cyclictest0-21swapper/311:42:403
3094499230,23cyclictest0-21swapper/310:51:503
3094499230,23cyclictest0-21swapper/310:20:203
3094499230,22cyclictest6024-21ssh09:21:403
3094499230,22cyclictest32595-21ssh09:16:243
3094499230,22cyclictest30652-21apt-get08:15:023
3094499230,22cyclictest22782-21sh10:05:013
3094499230,22cyclictest1955-21ssh10:15:213
3094499230,0cyclictest25480-21diskmemload11:32:513
3094499230,0cyclictest25480-21diskmemload10:55:143
3094499230,0cyclictest22197-21ssh12:00:153
3094499230,0cyclictest0-21swapper/312:17:463
3094499230,0cyclictest0-21swapper/310:05:333
3094499230,0cyclictest0-21swapper/309:50:473
30941992323,0cyclictest25480-21diskmemload11:48:592
30941992323,0cyclictest0-21swapper/211:56:092
30941992323,0cyclictest0-21swapper/211:20:222
30941992323,0cyclictest0-21swapper/211:20:222
30941992323,0cyclictest0-21swapper/210:32:202
30941992322,1cyclictest25480-21diskmemload10:37:222
30941992321,2cyclictest30160-21ssh12:36:102
30941992321,1cyclictest25480-21diskmemload09:33:332
30941992321,1cyclictest0-21swapper/211:33:342
30941992320,2cyclictest783-21snmpd11:50:202
30941992320,2cyclictest27133-21ssh10:08:292
30941992319,3cyclictest14187-21ssh09:58:062
3094199230,23cyclictest0-21swapper/212:06:452
3094199230,23cyclictest0-21swapper/209:36:122
3094199230,22cyclictest11646-21rm10:23:252
3094199230,22cyclictest0-21swapper/210:15:152
3094199230,0cyclictest25480-21diskmemload09:17:122
3094199230,0cyclictest0-21swapper/212:15:582
3094199230,0cyclictest0-21swapper/212:14:322
3094199230,0cyclictest0-21swapper/212:04:182
3094199230,0cyclictest0-21swapper/209:14:372
30938992323,0cyclictest0-21swapper/112:05:511
30938992323,0cyclictest0-21swapper/111:01:581
30938992323,0cyclictest0-21swapper/110:46:111
30938992323,0cyclictest0-21swapper/110:41:221
30938992323,0cyclictest0-21swapper/110:33:181
30938992323,0cyclictest0-21swapper/108:05:021
30938992321,1cyclictest0-21swapper/110:35:211
30938992321,1cyclictest0-21swapper/109:45:261
30938992320,2cyclictest11541-21ssh09:26:251
3093899230,23cyclictest0-21swapper/111:20:161
3093899230,23cyclictest0-21swapper/111:20:161
3093899230,23cyclictest0-21swapper/110:25:331
3093899230,22cyclictest622-21gdbus08:40:001
3093899230,22cyclictest4602-21munin-run09:20:001
3093899230,22cyclictest23078-21munin-run08:00:001
3093899230,22cyclictest20928-21ssh10:03:131
3093899230,22cyclictest0-21swapper/112:01:041
3093899230,22cyclictest0-21swapper/110:07:581
3093899230,22cyclictest0-21swapper/109:22:431
3093899230,1cyclictest0-21swapper/111:54:381
3093899230,0cyclictest0-21swapper/110:15:251
30934992323,0cyclictest0-21swapper/012:00:230
30934992323,0cyclictest0-21swapper/011:09:060
30934992323,0cyclictest0-21swapper/010:12:440
30934992323,0cyclictest0-21swapper/010:08:060
30934992323,0cyclictest0-21swapper/009:31:470
30934992322,1cyclictest0-21swapper/009:14:430
30934992321,1cyclictest0-21swapper/010:36:240
30934992320,2cyclictest5000-21awk11:45:000
30934992320,2cyclictest29814-21ssh12:08:000
30934992320,2cyclictest10303-21ssh11:20:260
30934992320,2cyclictest10303-21ssh11:20:260
3093499231,22cyclictest62550irq/127-eno111:48:120
3093499230,23cyclictest0-21swapper/010:22:320
3093499230,23cyclictest0-21swapper/009:25:410
3093499230,22cyclictest4040-21sh11:14:420
3093499230,22cyclictest3433-21ssh10:45:090
3093499230,22cyclictest19039-21sh10:30:040
3093499230,22cyclictest0-21swapper/012:22:420
3093499230,22cyclictest0-21swapper/011:32:020
3093499230,21cyclictest0-21swapper/011:58:500
3093499230,0cyclictest25480-21diskmemload12:19:210
3093499230,0cyclictest0-21swapper/011:15:310
3093499230,0cyclictest0-21swapper/010:54:210
30944992222,0cyclictest25480-21diskmemload11:15:183
30944992222,0cyclictest0-21swapper/312:07:023
30944992222,0cyclictest0-21swapper/310:42:143
30944992221,1cyclictest25480-21diskmemload10:25:443
30944992220,1cyclictest5886-21perf09:50:013
30944992220,1cyclictest0-21swapper/311:11:053
3094499220,21cyclictest877-21latency_hist07:15:003
3094499220,21cyclictest26467-21sh09:10:563
3094499220,21cyclictest25826-21rm11:05:023
3094499220,21cyclictest25480-21diskmemload12:10:563
3094499220,21cyclictest25480-21diskmemload11:50:493
3094499220,21cyclictest15456-21apt07:45:003
3094499220,21cyclictest10917-21sh09:25:433
3094499220,21cyclictest10778-21ssh11:21:013
3094499220,21cyclictest10778-21ssh11:21:013
3094499220,21cyclictest0-21swapper/309:10:013
3094499220,1cyclictest27450-21ssh09:40:113
3094499220,1cyclictest17463-21ssh11:27:363
3094499220,0cyclictest25480-21diskmemload12:39:373
3094499220,0cyclictest0-21swapper/311:55:493
3094499220,0cyclictest0-21swapper/310:31:293
3094499220,0cyclictest0-21swapper/309:36:043
30941992222,0cyclictest0-21swapper/211:25:562
30941992222,0cyclictest0-21swapper/210:46:482
30941992222,0cyclictest0-21swapper/210:12:262
30941992222,0cyclictest0-21swapper/209:40:462
30941992220,1cyclictest5086-21munin-run11:45:002
30941992220,1cyclictest30665-21munin-run08:15:012
30941992220,1cyclictest0-21swapper/212:20:572
30941992219,2cyclictest25476-21latency_hist08:05:002
3094199220,22cyclictest17871-21latency_hist07:50:002
3094199220,21cyclictest25480-21diskmemload11:10:422
3094199220,21cyclictest0-21swapper/212:30:552
3094199220,21cyclictest0-21swapper/210:52:412
3094199220,21cyclictest0-21swapper/210:40:212
3094199220,21cyclictest0-21swapper/210:01:302
3094199220,1cyclictest0-21swapper/209:22:482
3094199220,0cyclictest0-21swapper/212:25:402
30938992222,0cyclictest25480-21diskmemload11:45:591
30938992222,0cyclictest0-21swapper/112:20:331
30938992222,0cyclictest0-21swapper/109:36:501
30938992221,1cyclictest0-21swapper/109:40:451
30938992220,1cyclictest0-21swapper/112:30:061
30938992220,1cyclictest0-21swapper/108:58:041
3093899220,22cyclictest0-21swapper/109:10:191
3093899220,21cyclictest29543-21diskmemload10:11:171
3093899220,21cyclictest25480-21diskmemload11:05:491
3093899220,21cyclictest1049-21cat08:20:011
3093899220,21cyclictest0-21swapper/112:25:171
3093899220,21cyclictest0-21swapper/109:30:591
3093899220,1cyclictest622-21gdbus07:40:011
3093899220,1cyclictest30668-21apt-get08:15:011
30934992222,0cyclictest25480-21diskmemload09:52:030
30934992222,0cyclictest0-21swapper/010:25:030
30934992221,0cyclictest0-21swapper/008:15:020
30934992221,0cyclictest0-21swapper/007:58:050
30934992220,1cyclictest0-21swapper/009:20:390
30934992219,2cyclictest1254-21ssh09:46:040
3093499220,22cyclictest0-21swapper/010:17:580
3093499220,21cyclictest30344-21ssh10:40:180
3093499220,21cyclictest26358-21apt-get08:08:060
3093499220,21cyclictest25480-21diskmemload09:35:010
3093499220,21cyclictest0-21swapper/010:55:090
3093499220,21cyclictest0-21swapper/010:00:410
3093499220,1cyclictest17876-21dump-pmu-power07:50:000
3093499220,1cyclictest0-21swapper/012:28:300
30944992121,0cyclictest0-21swapper/309:55:023
30944992121,0cyclictest0-21swapper/307:23:043
30944992119,1cyclictest0-21swapper/309:00:013
3094499210,2cyclictest13555-21cat08:45:003
3094499210,21cyclictest0-21swapper/310:10:213
3094499210,20cyclictest0-21swapper/308:38:053
30941992121,0cyclictest0-21swapper/208:28:042
30941992119,1cyclictest23072-21grep08:00:002
3094199210,21cyclictest0-21swapper/211:00:032
3094199210,21cyclictest0-21swapper/208:15:022
3094199210,20cyclictest0-21swapper/211:35:162
30938992119,1cyclictest11606-21apt-get08:43:051
30934992119,1cyclictest0-21swapper/007:40:010
3093499210,0cyclictest6738-21apt-get08:33:050
3093499210,0cyclictest0-21swapper/008:20:020
30944992020,0cyclictest18753-21apt-get07:53:033
30944992020,0cyclictest0-21swapper/308:33:053
30944992020,0cyclictest0-21swapper/307:58:053
30944992020,0cyclictest0-21swapper/307:48:053
3094499200,0cyclictest4340-21apt-get08:28:053
30941992020,0cyclictest0-21swapper/207:18:022
30938992020,0cyclictest8600-21apt-get07:33:041
30938992020,0cyclictest0-21swapper/108:31:161
30938992018,1cyclictest8104-21turbostat.cron07:30:011
3093899200,20cyclictest0-21swapper/108:30:011
3093899200,0cyclictest0-21swapper/108:23:051
30934992020,0cyclictest0-21swapper/008:28:040
30934992020,0cyclictest0-21swapper/007:33:040
30944991919,0cyclictest10995-21apt-get07:38:043
3094499190,0cyclictest0-21swapper/307:18:023
30941991919,0cyclictest21203-21apt-get09:03:052
30941991919,0cyclictest0-21swapper/207:43:042
30941991919,0cyclictest0-21swapper/207:13:042
30941991918,1cyclictest3808-21apt-get07:23:042
30941991918,0cyclictest0-21swapper/207:33:042
30938991919,0cyclictest0-21swapper/107:53:041
30934991919,0cyclictest0-21swapper/009:08:050
30934991919,0cyclictest0-21swapper/008:03:030
30934991919,0cyclictest0-21swapper/007:28:050
30934991918,0cyclictest0-21swapper/007:13:040
30944991818,0cyclictest0-21swapper/307:28:043
30941991818,0cyclictest0-21swapper/208:23:052
3094199180,18cyclictest0-21swapper/207:50:022
30934991817,0cyclictest0-21swapper/007:53:030
30944991717,0cyclictest0-21swapper/308:03:033
30944991715,1cyclictest18313-21munin-run08:55:003
30941991717,0cyclictest0-21swapper/208:33:052
30941991717,0cyclictest0-21swapper/207:30:012
30941991714,2cyclictest28266-21munin-run08:10:002
30938991717,0cyclictest0-21swapper/107:43:041
30938991714,2cyclictest18288-21cron08:55:001
30934991717,0cyclictest0-21swapper/009:03:050
30934991717,0cyclictest0-21swapper/008:53:060
30934991716,0cyclictest13998-21apt-get08:48:030
30934991715,1cyclictest0-21swapper/007:23:040
30944991615,1cyclictest28749-21apt-get08:13:053
3094499160,15cyclictest14522-21perl08:48:053
30941991616,0cyclictest0-21swapper/208:48:032
30938991614,1cyclictest15964-21apt-get07:48:051
3093899160,15cyclictest15917-21munin-run08:50:001
30934991616,0cyclictest0-21swapper/008:38:050
30934991615,0cyclictest13571-21apt-get07:43:040
30944991515,0cyclictest0-21swapper/308:20:023
30944991515,0cyclictest0-21swapper/308:08:063
30941991515,0cyclictest0-21swapper/208:53:062
30938991515,0cyclictest0-21swapper/109:03:051
30938991513,1cyclictest3308-21wc07:20:001
30934991515,0cyclictest0-21swapper/008:43:050
3094499140,14cyclictest0-21swapper/307:30:323
30941991414,0cyclictest0-21swapper/209:05:132
30941991414,0cyclictest0-21swapper/208:55:442
3094199140,14cyclictest0-21swapper/208:41:292
3094199140,14cyclictest0-21swapper/207:36:292
30938991414,0cyclictest0-21swapper/109:05:041
3093899140,14cyclictest0-21swapper/107:20:031
3093899140,0cyclictest0-21swapper/108:00:091
3093499140,14cyclictest0-21swapper/007:15:070
3093499140,0cyclictest0-21swapper/008:55:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional