You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-17 - 06:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackaslot8.osadl.org (updated Tue Jun 17, 2025 00:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
133522279222,17sleep30-21swapper/319:06:173
135732268233,23sleep10-21swapper/119:08:531
133592265232,21sleep00-21swapper/019:06:210
134042262229,21sleep20-21swapper/219:06:532
157052650,0sleep20-21swapper/221:40:492
277602590,0sleep30-21swapper/321:26:083
277602590,0sleep30-21swapper/321:26:083
25442590,0sleep00-21swapper/022:20:190
38642570,0sleep30-21swapper/300:25:203
3702570,0sleep20-21swapper/221:30:152
301322560,0sleep00-21swapper/022:16:420
274922540,0sleep30-21swapper/322:15:143
184932540,0sleep20-21swapper/220:30:132
1376299160,2cyclictest323-21ssh00:22:271
278482150,0sleep20-21swapper/200:18:302
1376299151,9cyclictest27787-21awk20:50:161
1376299151,8cyclictest508-21dbus-daemon23:48:281
1376299150,1cyclictest19982-21systemd-journal23:02:191
162002140,1sleep00-21swapper/000:36:530
1376299140,3cyclictest30418-21grep23:30:221
1376299140,1cyclictest19982-21systemd-journal22:55:011
277532130,0sleep327754-21idleruntime-cro19:40:013
1376299132,7cyclictest0-21swapper/122:03:031
1376299131,8cyclictest6151-21processes00:00:221
1376299130,3cyclictest24045-21ssh23:50:141
1376299130,3cyclictest18743-21ssh22:57:011
1376299130,3cyclictest15737-21ssh00:36:121
1376299130,2cyclictest4934-21fschecks_time20:00:141
1376299130,2cyclictest32402-21ssh23:55:211
1376299130,2cyclictest2309-21diskstats22:45:161
137512130,0sleep20-21swapper/222:29:462
1376299122,6cyclictest28399-21sh23:05:121
1376299122,6cyclictest2773-21ls00:25:121
1376299122,6cyclictest18737-21ssh23:21:401
1376299121,0cyclictest2613-21apt-get23:10:161
1376299120,3cyclictest2735-21ssh21:55:281
1376299120,2cyclictest23823-21ssh21:47:271
1376299120,2cyclictest22197-21cut19:25:171
1376299120,2cyclictest22197-21cut19:25:171
1376299120,2cyclictest19982-21systemd-journal20:15:001
1376299120,2cyclictest12000-21gltestperf20:15:151
1376299120,1cyclictest3615-21diskmemload21:15:151
1376299120,1cyclictest19086-21apt-get19:20:141
1376299120,11cyclictest27716-21sendmail19:40:011
1376299112,8cyclictest24433-21ntpq00:15:171
1376299111,8cyclictest19982-21systemd-journal21:07:001
1376299111,0cyclictest21046-21apt-get22:35:161
1376299110,3cyclictest28400-21ssh22:15:191
1376299110,3cyclictest17357-21ssh22:07:051
1376299110,3cyclictest14344-21ssh22:30:051
1376299110,3cyclictest13909-21chrt23:18:351
1376299110,3cyclictest11342-21ssh00:05:171
1376299110,2cyclictest3615-21diskmemload21:33:241
1376299110,2cyclictest28381-21ls22:40:181
1376299110,2cyclictest27589-21expr21:50:211
1376299110,2cyclictest22503-21sshd22:10:361
1376299110,2cyclictest20511-21ssh21:20:501
1376299110,2cyclictest19982-21systemd-journal20:10:001
1376299110,2cyclictest18128-21/usr/sbin/munin20:30:201
1376299110,2cyclictest17697-21chrt20:27:401
1376299110,1cyclictest3615-21diskmemload23:42:181
1376299110,1cyclictest3615-21diskmemload21:37:391
1376299110,1cyclictest3410-21mailstats19:55:201
1376299110,1cyclictest28619-21basename19:40:151
1376299110,1cyclictest22348-21ssh23:25:061
1376299110,1cyclictest15666-21chrt19:11:481
1376299110,1cyclictest14971-21ls20:20:221
1376299110,1cyclictest12598-21ssh00:34:361
1376299110,1cyclictest105062chrt22:26:161
1376299110,1cyclictest0-21swapper/121:40:031
1376299110,1cyclictest0-21swapper/120:45:231
1375899114,4cyclictest24596-21munin-run20:45:000
1376299103,6cyclictest30654-21snmpd21:25:301
1376299103,6cyclictest30654-21snmpd21:25:301
1376299101,8cyclictest673-21cat19:50:161
1376299101,2cyclictest4448-21df21:10:131
1376299101,1cyclictest3615-21diskmemload00:12:381
1376299101,1cyclictest30227-21apt-get19:45:131
1376299100,3cyclictest31080-21sed20:55:211
1376299100,2cyclictest502-21systemd-logind23:35:071
1376299100,2cyclictest32235-21sh21:00:131
1376299100,1cyclictest203482chrt20:35:051
1376299100,1cyclictest0-21swapper/122:20:241
1376299100,1cyclictest0-21swapper/119:30:201
137719994,3cyclictest19982-21systemd-journal20:29:033
137719990,8cyclictest21200-21sh21:21:313
137679994,3cyclictest19982-21systemd-journal23:12:352
137629990,3cyclictest16355-21cat19:15:011
137629990,2cyclictest23670-21awk20:40:201
27673280,0sleep30-21swapper/323:52:243
26770280,0sleep30-21swapper/323:28:023
137719984,3cyclictest508-21dbus-daemon22:00:013
137719983,3cyclictest19982-21systemd-journal19:33:593
137679984,3cyclictest19982-21systemd-journal23:03:362
137679984,3cyclictest19982-21systemd-journal21:20:002
137679983,3cyclictest19982-21systemd-journal20:53:142
137679983,3cyclictest19982-21systemd-journal00:31:012
137589987,1cyclictest12-21ksoftirqd/022:10:000
137589984,3cyclictest6206-21sshd22:48:000
137589983,3cyclictest19982-21systemd-journal19:54:000
137719974,2cyclictest508-21dbus-daemon20:30:183
137719974,2cyclictest508-21dbus-daemon20:06:563
137719973,3cyclictest30654-21snmpd23:49:463
137719973,3cyclictest30654-21snmpd19:12:473
137719973,3cyclictest29981-21df20:55:143
137719973,3cyclictest25819-21ntpq20:45:223
137719973,3cyclictest19982-21systemd-journal00:31:263
137719973,1cyclictest0-21swapper/323:23:313
137719973,1cyclictest0-21swapper/322:44:113
137719972,3cyclictest19982-21systemd-journal21:33:423
137719970,3cyclictest24685-21ssh23:01:263
137719970,3cyclictest10262-21head23:15:193
137679973,3cyclictest508-21dbus-daemon23:59:592
137679973,3cyclictest508-21dbus-daemon20:44:292
137679973,3cyclictest508-21dbus-daemon20:05:002
137679973,3cyclictest32019-21udisksd19:13:122
137679973,3cyclictest19982-21systemd-journal20:50:002
137679973,3cyclictest0-21swapper/221:27:462
137679973,3cyclictest0-21swapper/221:27:462
137679973,1cyclictest0-21swapper/221:11:112
137679972,3cyclictest19982-21systemd-journal00:06:352
137589975,1cyclictest12-21ksoftirqd/000:05:000
137589974,2cyclictest508-21dbus-daemon21:43:440
137589974,2cyclictest502-21systemd-logind00:21:250
137589974,2cyclictest19982-21systemd-journal23:53:350
137589974,2cyclictest19982-21systemd-journal00:20:000
137589974,2cyclictest12-21ksoftirqd/020:10:000
137589974,2cyclictest11736-21in:imuxsock23:36:470
137589973,3cyclictest30654-21snmpd23:12:450
137589973,3cyclictest30654-21snmpd20:27:370
137589973,3cyclictest30654-21snmpd19:22:080
137589973,3cyclictest30542-21sed23:30:230
137589973,3cyclictest19982-21systemd-journal19:36:540
137589973,3cyclictest1-21systemd23:45:320
137589973,3cyclictest0-21swapper/022:25:460
137589973,3cyclictest0-21swapper/021:31:270
137589973,3cyclictest0-21swapper/021:27:000
137589973,3cyclictest0-21swapper/021:27:000
137589972,3cyclictest19982-21systemd-journal19:48:100
137589972,3cyclictest19982-21systemd-journal00:00:000
137589971,4cyclictest19982-21systemd-journal21:01:100
137589971,3cyclictest1906-21rm21:55:180
137589970,6cyclictest0-21swapper/022:40:030
13165270,0sleep00-21swapper/022:53:030
9217260,1sleep00-21swapper/023:15:120
137719966,0cyclictest0-21swapper/322:10:513
137719966,0cyclictest0-21swapper/322:00:373
137719963,2cyclictest9246-21cut22:50:143
137719963,2cyclictest3123-21needreboot19:55:173
137719963,2cyclictest26603-21sh21:50:053
137719963,2cyclictest12785-21wc20:15:213
137719963,2cyclictest11736-21in:imuxsock22:20:023
137719963,2cyclictest0-21swapper/300:10:143
137719963,1cyclictest0-21swapper/321:36:133
137719962,3cyclictest508-21dbus-daemon19:15:123
137719962,3cyclictest4181-21cat23:35:203
137719962,3cyclictest31156-21cut23:55:143
137719962,3cyclictest30654-21snmpd23:42:553
137719962,3cyclictest30654-21snmpd22:55:243
137719962,3cyclictest30654-21snmpd20:40:343
137719962,3cyclictest30654-21snmpd20:39:273
137719962,3cyclictest30654-21snmpd20:00:543
137719962,3cyclictest30654-21snmpd19:47:423
137719962,3cyclictest30654-21snmpd00:07:133
137719962,3cyclictest29480-21wc20:55:013
137719962,3cyclictest29431-21cat23:30:173
137719962,3cyclictest29366-21sed19:40:203
137719962,3cyclictest2316-21cat21:05:163
137719962,3cyclictest20015-21ntpq19:20:183
137719962,3cyclictest14253-21grep20:20:173
137719962,3cyclictest0-21swapper/322:05:083
137719962,1cyclictest0-21swapper/323:14:543
137719962,1cyclictest0-21swapper/322:35:023
137719962,1cyclictest0-21swapper/322:31:113
137719962,1cyclictest0-21swapper/321:17:043
137719962,1cyclictest0-21swapper/300:00:153
137719961,3cyclictest19982-21systemd-journal21:48:183
137719961,3cyclictest19982-21systemd-journal00:22:403
137719961,2cyclictest5353-21ssh22:47:093
137719961,1cyclictest13327-21apt-get00:35:133
137719960,6cyclictest0-21swapper/322:25:313
137719960,5cyclictest13281-21gdbus21:40:013
137719960,3cyclictest19982-21systemd-journal21:10:203
137719960,2cyclictest29802-21switchtime23:05:213
137719960,2cyclictest23388-21/usr/sbin/munin00:15:123
137679966,0cyclictest0-21swapper/219:15:022
137679964,1cyclictest668-21runrttasks21:05:132
137679963,2cyclictest668-21runrttasks23:51:292
137679963,2cyclictest508-21dbus-daemon23:16:452
137679963,2cyclictest30654-21snmpd21:39:582
137679963,2cyclictest30654-21snmpd19:49:302
137679963,2cyclictest20764-21df20:35:182
137679963,2cyclictest17897-21idleruntime-cro20:30:002
137679963,2cyclictest16866-21grep23:20:202
137679963,2cyclictest1231-21/usr/sbin/munin22:20:162
137679963,2cyclictest0-21swapper/222:18:162
137679962,3cyclictest32516-21cat21:00:152
137679962,3cyclictest30654-21snmpd23:31:402
137679962,3cyclictest30654-21snmpd23:25:032
137679962,3cyclictest30654-21snmpd22:51:542
137679962,3cyclictest30654-21snmpd20:21:512
137679962,3cyclictest30654-21snmpd20:10:392
137679962,3cyclictest30654-21snmpd19:57:392
137679962,3cyclictest30654-21snmpd19:41:092
137679962,3cyclictest30654-21snmpd19:23:022
137679962,3cyclictest30420-21cat00:20:152
137679962,3cyclictest29741-11brltty22:05:512
137679962,3cyclictest27195-21grep19:35:222
137679962,3cyclictest24830-21cat19:30:232
137679962,3cyclictest22538-21cat19:25:202
137679962,3cyclictest22538-21cat19:25:202
137679962,3cyclictest19982-21systemd-journal22:47:562
137679962,3cyclictest19982-21systemd-journal00:27:152
137679962,3cyclictest1-21systemd19:52:202
137679962,3cyclictest0-21swapper/222:35:032
137679962,1cyclictest141rcu_preempt22:55:172
137679962,1cyclictest0-21swapper/223:41:372
137679962,1cyclictest0-21swapper/223:05:012
137679962,1cyclictest0-21swapper/222:40:122
137679962,1cyclictest0-21swapper/222:10:172
137679962,1cyclictest0-21swapper/221:21:102
137679962,1cyclictest0-21swapper/200:11:562
137679962,1cyclictest0-21swapper/200:00:052
137679961,4cyclictest0-21swapper/223:35:522
137679961,3cyclictest19982-21systemd-journal20:19:012
137679961,2cyclictest2265-21ssh21:55:202
137679961,2cyclictest18960-21ssh23:45:232
137679960,6cyclictest0-21swapper/222:00:122
137679960,6cyclictest0-21swapper/221:50:132
137679960,4cyclictest3615-21diskmemload22:30:222
137679960,0cyclictest0-21swapper/200:35:072
137589964,1cyclictest27356-21/usr/sbin/munin20:50:220
137589963,2cyclictest9958-21ssh00:30:530
137589963,2cyclictest4474-21forks21:10:140
137589963,2cyclictest31342-21chrt20:57:300
137589963,2cyclictest30734-21ssh21:52:430
137589963,2cyclictest30654-21snmpd19:30:030
137589963,2cyclictest30654-21snmpd00:10:320
137589963,2cyclictest21630-21expr19:25:130
137589963,2cyclictest21630-21expr19:25:130
137589963,2cyclictest11736-21in:imuxsock23:26:460
137589963,2cyclictest11736-21in:imuxsock20:30:430
137589963,2cyclictest11450-21cpuspeed_turbos00:05:170
137589963,1cyclictest0-21swapper/022:01:290
137589962,3cyclictest5156-21cat20:00:170
137589962,3cyclictest30654-21snmpd21:35:450
137589962,3cyclictest30654-21snmpd21:20:140
137589962,3cyclictest30654-21snmpd21:05:190
137589962,3cyclictest30654-21snmpd19:16:500
137589962,3cyclictest30654-21snmpd19:10:440
137589962,3cyclictest30654-21snmpd00:25:260
137589962,3cyclictest20827-21gltestperf21:45:170
137589962,3cyclictest19982-21systemd-journal20:47:240
137589962,3cyclictest12138-21cat20:15:160
137589962,3cyclictest11580-21cut21:15:150
137589962,3cyclictest0-21swapper/023:23:430
137589962,3cyclictest0-21swapper/022:55:220
137589962,3cyclictest0-21swapper/022:10:320
137589962,1cyclictest0-21swapper/023:07:490
137589962,1cyclictest0-21swapper/022:39:300
137589961,2cyclictest14973-21ssh22:30:160
137589960,4cyclictest19982-21systemd-journal20:20:170
137589960,3cyclictest21866-21rm23:00:060
12922260,0sleep00-21swapper/023:41:280
137719952,2cyclictest9168-21cp20:10:013
137719952,2cyclictest21710-21fschecks_count19:25:143
137719952,2cyclictest21710-21fschecks_count19:25:143
137719951,3cyclictest32456-21apt-get19:50:133
137719951,2cyclictest19982-21systemd-journal21:00:013
137679953,1cyclictest7086-21df20:05:152
137679952,2cyclictest29704-21cpuspeed_turbos20:55:132
137679952,2cyclictest20209-21ssh21:45:142
137589954,1cyclictest12-21ksoftirqd/020:10:010
137589953,1cyclictest20364-21/usr/sbin/munin20:35:180
137589952,2cyclictest28293-21expr19:40:120
137589952,2cyclictest2309-21cat19:55:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional