You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 12:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu May 07, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27069211812,73sleep027095-21idleruntime-cro19:01:420
272209911045,58cyclictest0-21swapper/000:26:520
2660621060,6sleep20-21swapper/222:37:092
27233999681,8cyclictest0-21swapper/223:51:462
268872956,15sleep20-21swapper/218:59:192
27220999478,10cyclictest5060-21/usr/sbin/munin19:32:130
27220999248,30cyclictest20249-21apt-get23:21:520
27220999174,11cyclictest298-21in:imuxsock00:06:400
27220999152,31cyclictest2820-21apt-get23:46:520
27220999137,42cyclictest0-21swapper/019:11:560
27220999137,42cyclictest0-21swapper/019:11:560
27220999050,28cyclictest2334-21apt-get21:56:510
27220999038,40cyclictest23632-21grep00:21:430
2723399893,61cyclictest20847-21apt-get00:16:572
27220998938,22cyclictest14368-21/usr/sbin/munin22:17:000
27225998869,11cyclictest0-21swapper/122:47:091
27233998762,19cyclictest26841-21cpuspeed00:26:562
27220998751,28cyclictest0-21swapper/023:31:530
27220998751,28cyclictest0-21swapper/023:31:530
27225998664,14cyclictest29262-21fschecks_time22:42:021
27225998664,11cyclictest0-21swapper/121:57:181
27225998663,13cyclictest0-21swapper/120:46:441
27220998664,16cyclictest544-21cron21:46:410
27220998633,25cyclictest13645-21ssh22:16:040
27225998569,9cyclictest0-21swapper/122:36:441
27225998569,9cyclictest0-21swapper/122:36:441
27225998567,11cyclictest0-21swapper/100:27:171
27220998568,10cyclictest0-21swapper/020:42:180
27220998553,22cyclictest23086-21ssh22:31:520
27220998553,22cyclictest23086-21ssh22:31:520
27220998547,22cyclictest32690-21apt-get19:16:530
27220998537,20cyclictest30013-21open_inodes23:37:120
27220998536,38cyclictest22942-21latency_hist22:31:440
27225998468,11cyclictest0-21swapper/122:07:101
27225998464,14cyclictest14044-21mailstats19:57:161
27225998464,14cyclictest14044-21mailstats19:57:161
27225998463,11cyclictest0-21swapper/120:12:031
27220998465,10cyclictest11771-21apt-get19:51:510
27220998463,12cyclictest0-21swapper/022:22:030
27220998463,12cyclictest0-21swapper/022:22:030
27220998448,21cyclictest2477-21apt-get22:51:520
27220998448,21cyclictest2477-21apt-get22:51:520
27220998443,31cyclictest29185-21ssh22:42:000
27225998368,8cyclictest0-21swapper/120:32:041
27225998363,11cyclictest0-21swapper/119:27:161
27220998347,31cyclictest0-21swapper/021:16:530
27220998347,31cyclictest0-21swapper/021:16:530
27220998347,21cyclictest10138-21apt-get19:46:520
27220998337,38cyclictest23851-21grep00:21:560
27220998336,22cyclictest8563-21fschecks_time22:07:040
27225998262,14cyclictest1669-21diskmemload22:12:161
27225998262,13cyclictest2374-21systemd-journal23:39:341
27225998260,11cyclictest0-21swapper/119:01:531
27225998248,20cyclictest0-21swapper/123:27:021
27220998262,9cyclictest26304-21apt-get20:36:520
27220998248,23cyclictest18244-21apt-get20:11:520
27220998242,31cyclictest0-21swapper/022:46:570
27220998236,30cyclictest4204-21ssh21:05:250
27220998233,25cyclictest24867-21kworker/u17:0+rpciod22:36:550
27220998231,43cyclictest0-21swapper/020:27:150
27233998161,13cyclictest0-21swapper/220:21:412
27225998166,8cyclictest0-21swapper/122:56:441
27225998166,8cyclictest0-21swapper/122:56:441
27225998157,16cyclictest0-21swapper/123:12:151
27225998157,16cyclictest0-21swapper/123:12:151
27220998168,7cyclictest0-21swapper/023:02:160
27220998147,24cyclictest11356-21apt-get23:06:520
27220998137,35cyclictest23465-21ssh23:26:560
27220998135,35cyclictest2170-21ssh21:56:440
27220998134,38cyclictest8482-21ssh21:12:070
27225998066,8cyclictest0-21swapper/120:02:091
27225998066,8cyclictest0-21swapper/120:02:091
27225998062,11cyclictest0-21swapper/123:06:591
27225998062,11cyclictest0-21swapper/120:46:581
27225998057,15cyclictest23548-21ntp_kernel_err20:27:101
27220998050,20cyclictest4975-21apt-get21:06:530
27220998048,26cyclictest0-21swapper/021:36:560
27220998046,23cyclictest29527-21apt-get20:46:520
27220998033,40cyclictest14855-21df00:06:590
27233997922,23cyclictest20939-21awk21:32:182
27233997922,23cyclictest20939-21awk21:32:182
27225997965,10cyclictest27209-21cyclictest00:06:571
27225997964,8cyclictest0-21swapper/119:32:071
27225997962,13cyclictest25735-21kworker/u17:2+events_unbound21:21:411
27225997962,13cyclictest25735-21kworker/u17:2+events_unbound21:21:411
27225997962,10cyclictest0-21swapper/122:27:171
27225997961,13cyclictest20650-21apt-key00:16:461
27225997934,38cyclictest0-21swapper/123:16:551
27220997959,11cyclictest0-21swapper/023:52:140
27220997959,11cyclictest0-21swapper/023:52:140
27220997949,20cyclictest8758-21apt-get23:56:500
27220997940,29cyclictest1208-21grep20:57:180
27220997935,35cyclictest20344-21ssh21:32:060
27220997935,35cyclictest20344-21ssh21:32:060
27220997934,38cyclictest6445-21unixbench_multi22:57:180
27233997848,22cyclictest18075-21latency_hist20:11:442
27225997864,8cyclictest0-21swapper/120:21:571
27225997864,8cyclictest0-21swapper/120:21:571
27225997861,10cyclictest6854-21fschecks_count19:37:021
27220997859,10cyclictest0-21swapper/019:41:450
27220997840,26cyclictest17528-21/usr/sbin/munin20:07:180
27220997836,34cyclictest8685-21cpuspeed19:43:010
27225997763,10cyclictest0-21swapper/121:42:141
27225997761,8cyclictest0-21swapper/121:27:031
27225997757,12cyclictest22571-21latency_hist21:36:451
27225997757,12cyclictest22571-21latency_hist21:36:451
27225997754,14cyclictest0-21swapper/123:52:031
27225997754,14cyclictest0-21swapper/123:52:031
27225997754,14cyclictest0-21swapper/123:36:261
27225997754,14cyclictest0-21swapper/123:36:261
27220997758,11cyclictest0-21swapper/021:23:020
27220997753,14cyclictest0-21swapper/022:02:230
27220997746,21cyclictest27402-21apt-get19:01:520
27220997741,25cyclictest0-21swapper/019:06:570
27220997741,25cyclictest0-21swapper/019:06:570
27220997740,27cyclictest13605-21tune2fs19:57:040
27220997740,27cyclictest13605-21tune2fs19:57:040
2591027710,45sleep125919-21/usr/sbin/munin18:57:061
27233997657,11cyclictest0-21swapper/222:42:182
27233997652,16cyclictest11574-21latency_hist00:01:432
27233997645,22cyclictest352-21runrttasks20:32:142
27225997656,9cyclictest0-21swapper/119:47:031
27225997656,11cyclictest0-21swapper/122:02:131
27225997655,11cyclictest0-21swapper/122:22:081
27225997655,11cyclictest0-21swapper/122:22:081
27225997643,24cyclictest5518-40mandb23:51:461
27225997633,32cyclictest14212-21ssh22:16:571
27220997647,20cyclictest14997-21chrt20:01:520
27220997647,20cyclictest14997-21chrt20:01:520
27220997646,24cyclictest0-21swapper/021:26:530
27220997646,24cyclictest0-21swapper/019:21:540
27220997637,29cyclictest1-21systemd23:21:410
27220997634,31cyclictest31340-21ssh21:51:180
27225997555,10cyclictest0-21swapper/100:22:031
27220997535,28cyclictest17672-21ssh00:11:530
27233997453,12cyclictest0-21swapper/222:17:092
27233997448,19cyclictest31071-21latency_hist20:51:452
27233997444,22cyclictest1669-21diskmemload22:24:132
27233997444,22cyclictest1669-21diskmemload22:24:132
27233997430,19cyclictest1669-21diskmemload21:26:452
27225997458,8cyclictest0-21swapper/121:52:201
27225997456,8cyclictest0-21swapper/120:17:171
27225997455,9cyclictest0-21swapper/121:26:441
27225997454,11cyclictest0-21swapper/123:01:341
27220997445,20cyclictest0-21swapper/020:51:580
27220997445,20cyclictest0-21swapper/020:51:580
27220997442,24cyclictest14383-21/usr/sbin/munin23:11:570
27220997442,24cyclictest14383-21/usr/sbin/munin23:11:570
27220997439,25cyclictest22059-21/usr/sbin/munin20:22:130
27220997439,25cyclictest22059-21/usr/sbin/munin20:22:130
27220997436,31cyclictest32710-21cat23:42:050
27233997346,19cyclictest19211-21sh00:13:352
27233997326,23cyclictest1669-21diskmemload21:17:072
27233997326,23cyclictest1669-21diskmemload21:17:072
27225997358,8cyclictest0-21swapper/121:41:441
27225997357,8cyclictest0-21swapper/119:17:021
27225997355,8cyclictest0-21swapper/100:11:571
27225997354,10cyclictest0-21swapper/119:43:191
27225997353,15cyclictest0-21swapper/119:22:141
27225997353,11cyclictest0-21swapper/123:03:521
27220997347,20cyclictest0-21swapper/019:26:520
27220997339,25cyclictest21202-21munin-plugin-st20:21:410
27220997336,25cyclictest25177-21ntpq20:32:080
106702730,15sleep2381ktimers/222:11:062
27233997243,22cyclictest27209-21cyclictest23:12:062
27233997243,22cyclictest27209-21cyclictest23:12:062
27225997258,8cyclictest0-21swapper/121:06:441
27225997257,8cyclictest0-21swapper/121:12:171
27225997252,10cyclictest0-21swapper/119:52:061
27233997150,13cyclictest20048-21latency_hist23:21:432
27233997143,20cyclictest2382-21latency_hist22:51:442
2723399712,20cyclictest31454-21kernelversion19:12:062
2723399712,20cyclictest31454-21kernelversion19:12:062
27225997152,13cyclictest2580-21latency_hist23:46:431
27225997152,10cyclictest0-21swapper/123:21:581
27225997151,12cyclictest0-21swapper/119:07:091
27225997151,12cyclictest0-21swapper/119:07:091
92552700,6sleep30-21swapper/323:02:143
27233997048,16cyclictest26872-21unixbench_multi21:42:192
27233997047,17cyclictest19652-21sh21:31:412
27233997044,20cyclictest11238-21latency_hist23:06:442
27233997044,18cyclictest2312-21sh21:56:502
27233997041,20cyclictest25710-21latency_hist22:36:442
27233997041,20cyclictest25710-21latency_hist22:36:442
27233997026,26cyclictest22397-21grep20:22:172
27233997026,26cyclictest22397-21grep20:22:172
27225997053,11cyclictest4955-21/usr/sbin/munin21:06:521
27225997053,10cyclictest0-21swapper/123:57:181
2629227013,34sleep30-21swapper/318:57:213
27233996954,8cyclictest0-21swapper/221:51:592
27233996949,14cyclictest5273-21/usr/sbin/munin22:02:152
27233996949,14cyclictest25527-21latency_hist21:41:442
27233996949,11cyclictest0-21swapper/200:21:572
27233996944,17cyclictest352-21runrttasks21:12:162
27233996944,17cyclictest0-21swapper/220:52:102
27233996944,17cyclictest0-21swapper/220:52:102
27233996938,23cyclictest11332-21cstates22:11:562
27233996846,15cyclictest27209-21cyclictest23:33:452
27233996846,15cyclictest27209-21cyclictest23:33:452
27233996841,19cyclictest2310-21netstat19:22:092
27233996841,17cyclictest2374-21systemd-journal23:55:042
27233996841,17cyclictest2374-21systemd-journal23:55:042
27233996831,28cyclictest27661-21cut19:02:032
27233996831,27cyclictest29427-21sort19:06:542
27233996831,27cyclictest29427-21sort19:06:542
2723399682,53cyclictest23962-21ssh23:27:582
27225996855,7cyclictest0-21swapper/122:37:161
27225996854,8cyclictest0-21swapper/120:52:111
27225996854,8cyclictest0-21swapper/120:52:111
27233996747,14cyclictest1781-21latency_hist21:01:442
27233996746,12cyclictest0-21swapper/200:07:152
27233996745,16cyclictest298-21in:imuxsock20:43:242
27233996745,14cyclictest15518-21ntp_offset20:02:092
27233996745,14cyclictest15518-21ntp_offset20:02:092
27233996741,18cyclictest1025-21timerandwakeup19:17:172
27233996741,16cyclictest14019-21munin-run23:11:412
27225996752,8cyclictest0-21swapper/119:16:441
27225996752,8cyclictest0-21swapper/119:16:441
27225996748,9cyclictest0-21swapper/120:56:581
27225996740,19cyclictest16852-21grep20:07:041
27233996650,7cyclictest0-21swapper/222:57:042
27233996647,12cyclictest7848-21latency_hist21:11:452
27233996643,15cyclictest2374-21systemd-journal23:44:522
27233996641,12cyclictest0-21swapper/220:11:512
27225996653,7cyclictest0-21swapper/120:37:141
27225996652,8cyclictest0-21swapper/121:47:191
27225996652,10cyclictest27209-21cyclictest00:06:401
26552660,9sleep30-21swapper/321:02:143
27233996543,14cyclictest2374-21systemd-journal23:37:342
27233996543,13cyclictest0-21swapper/223:22:072
27233996539,20cyclictest12576-21threads00:02:162
27233996536,18cyclictest0-21swapper/219:56:442
27233996528,25cyclictest27060-21awk20:37:162
39382640,7sleep20-21swapper/221:04:402
27233996446,12cyclictest31733-21cat21:51:452
27233996444,14cyclictest5891-21timerandwakeup19:32:172
306532630,6sleep30-21swapper/322:43:553
27233996244,13cyclictest2511-21cpu22:51:572
27233996244,13cyclictest2511-21cpu22:51:572
27233996244,13cyclictest14236-21timerwakeupswit19:57:182
27233996244,13cyclictest14236-21timerwakeupswit19:57:182
27233996232,21cyclictest3638-21cut19:27:022
27233996142,13cyclictest7031-21kernelversion19:37:052
27233996142,12cyclictest23721-21mailstats20:27:152
27233996135,17cyclictest11572-21latency_hist19:51:432
27233996020,25cyclictest9243-21cat19:43:172
27233996013,23cyclictest20614-21memory22:27:092
27238995929,19cyclictest4793-21chrt19:31:413
27238995922,24cyclictest31864-21chrt21:51:583
27238995724,21cyclictest5476-21chrt22:01:593
27238995723,22cyclictest19347-21chrt20:13:463
27238995722,23cyclictest26777-21chrt22:37:143
27238995721,25cyclictest6671-21taskset22:57:403
27238995721,23cyclictest15278-21chrt22:17:203
27238995623,21cyclictest32009-21chrt20:52:183
27238995623,21cyclictest32009-21chrt20:52:183
27238995622,24cyclictest2677-21chrt23:46:443
27238995620,24cyclictest20206-21taskset00:16:263
27238995619,24cyclictest16604-21chrt20:06:533
27238995522,21cyclictest5762-21chrt21:07:173
27238995521,21cyclictest9206-21chrt22:07:183
27238995521,21cyclictest4838-21chrt22:01:183
27238995521,21cyclictest13839-21chrt22:16:393
27238995520,23cyclictest6033-21chrt19:32:183
27238995520,23cyclictest12262-21chrt00:02:083
27238995520,22cyclictest19468-21chrt21:31:223
27238995520,21cyclictest16429-21chrt23:15:073
27238995520,21cyclictest16429-21chrt23:15:073
27238995519,22cyclictest27924-21chrt20:41:533
27238995423,20cyclictest8445-21chrt19:41:463
27238995422,20cyclictest17742-21chrt22:22:103
27238995422,20cyclictest17742-21chrt22:22:103
27238995421,21cyclictest25841-21chrt21:41:523
27238995420,23cyclictest31235-21chrt19:12:013
27238995420,23cyclictest31235-21chrt19:12:013
27238995420,23cyclictest20101-21taskset22:26:523
27238995419,23cyclictest24720-21taskset21:39:253
27238995419,22cyclictest31427-21chrt21:51:333
27238995419,21cyclictest22556-21chrt00:19:023
27238995418,24cyclictest27991-21taskset23:33:393
27238995418,24cyclictest27991-21taskset23:33:393
27238995418,24cyclictest21696-21chrt23:23:183
27238995320,22cyclictest24196-21taskset23:28:043
27238995320,21cyclictest21516-21chrt21:33:413
27238995320,21cyclictest21516-21chrt21:33:413
27238995320,21cyclictest1690-21chrt22:50:273
27238995319,22cyclictest28942-21chrt00:30:253
27238995319,22cyclictest25630-21chrt22:36:293
27238995319,22cyclictest25630-21chrt22:36:293
27238995319,21cyclictest29973-21chrt20:47:073
27238995318,23cyclictest11569-21taskset21:17:103
27238995318,23cyclictest11569-21taskset21:17:103
27238995318,22cyclictest27291-21taskset20:37:193
27238995318,22cyclictest13539-21chrt19:57:013
27238995318,22cyclictest13539-21chrt19:57:013
27238995318,21cyclictest9912-21chrt23:57:263
27238995221,20cyclictest17334-21chrt23:16:573
27238995221,19cyclictest14572-21chrt21:23:033
27238995220,21cyclictest29553-21chrt23:36:593
27238995220,19cyclictest13147-21chrt23:09:153
27238995219,21cyclictest20196-21chrt20:17:063
27238995219,20cyclictest8294-21chrt21:12:033
27238995120,21cyclictest763-21chrt20:57:083
27238995119,21cyclictest5409-21chrt23:51:343
27238995119,20cyclictest28644-21chrt19:05:373
27238995119,20cyclictest25843-21chrt20:34:193
27238995118,22cyclictest24425-21chrt00:22:103
27238995118,21cyclictest3819-21chrt22:52:583
27238995118,21cyclictest3819-21chrt22:52:583
27238995118,20cyclictest16933-21chrt00:10:353
27238995020,19cyclictest23413-21chrt20:27:063
27238995016,22cyclictest30630-21chrt19:09:503
27238995016,22cyclictest30630-21chrt19:09:503
27238995016,22cyclictest11446-21chrt19:51:263
27238995012,26cyclictest6588-21taskset23:52:153
27238995012,26cyclictest6588-21taskset23:52:153
27238994919,20cyclictest1329-21chrt19:18:413
27238994919,20cyclictest12845-21chrt19:53:163
27238994917,21cyclictest16159-21chrt20:04:343
27238994917,21cyclictest16159-21chrt20:04:343
27238994916,19cyclictest2845-21chrt19:22:303
27238994816,19cyclictest22454-21chrt20:22:253
27238994816,19cyclictest22454-21chrt20:22:253
27238994514,21cyclictest9624-21chrt19:43:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional