You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 02:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Wed Dec 03, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2953021010,0sleep20-21swapper/222:11:062
2921221000,0sleep20-21swapper/221:58:152
107112960,0sleep11128999cyclictest22:38:111
87822910,1sleep21129699cyclictest22:34:532
121052900,0sleep20-21swapper/200:02:042
128292890,2sleep21129699cyclictest21:18:072
225392760,2sleep11128999cyclictest00:37:081
25882700,0sleep32586-21lspci21:13:523
195072680,0sleep319505-21sshd21:41:143
109822660,1sleep0101ktimersoftd/023:10:280
68192640,0sleep10-21swapper/123:58:151
320122610,0sleep00-21swapper/023:35:030
320992600,1sleep20-21swapper/223:41:262
31292570,0sleep10-21swapper/100:31:431
314662550,0sleep00-21swapper/000:10:590
312412550,0sleep20-21swapper/200:24:352
294522550,0sleep30-21swapper/322:59:293
86992540,1sleep38701-21bash22:18:443
300042540,0sleep00-21swapper/022:17:370
264982520,2sleep01128499cyclictest00:17:160
129562520,0sleep012940-21sshd23:55:330
221052510,0sleep30-21swapper/322:00:423
287562490,0sleep00-21swapper/023:25:100
36682480,0sleep30-21swapper/323:51:283
36682480,0sleep30-21swapper/323:51:273
32012480,0sleep30-21swapper/323:57:533
124392450,2sleep31129799cyclictest23:36:133
118142420,0sleep01128499cyclictest21:18:010
1085923323,6sleep20-21swapper/219:05:552
109472319,7sleep10-21swapper/119:06:581
110642309,7sleep30-21swapper/319:08:243
1085722412,7sleep00-21swapper/019:05:530
89812210,0sleep18980-21sshd22:02:401
60802210,0sleep10-21swapper/122:05:321
145852210,1sleep10-21swapper/122:45:011
95972180,1sleep09581-21sshd21:10:280
1128499180,16cyclictest14588-21sshd00:32:550
296072170,1sleep329587-21sshd23:47:393
229052170,1sleep2311rcuc/222:26:322
21862160,1sleep12184-21lspci23:41:411
95412150,0sleep20-21swapper/200:39:132
270612150,0sleep30-21swapper/323:40:553
11284991514,0cyclictest0-21swapper/022:25:350
32752140,0sleep10-21swapper/121:30:071
298372140,1sleep1231rcuc/123:02:431
202672140,0sleep30-21swapper/322:13:273
152632140,2sleep1616-17auditd00:19:341
12082140,0sleep00-21swapper/021:45:480
11296991410,3cyclictest5901-21sshd23:13:152
1129699140,12cyclictest12802-21bash22:06:142
1129699140,11cyclictest0-21swapper/222:00:542
242782130,0sleep00-21swapper/000:37:190
134542130,0sleep00-21swapper/021:53:300
1128999130,1cyclictest1615-21bash21:20:151
1128999130,12cyclictest19508-21sshd22:42:151
1128499130,1cyclictest5804-21sshd21:20:340
10392130,0sleep10-21swapper/123:25:301
11297991210,1cyclictest0-21swapper/323:24:383
1129799120,1cyclictest32306-21bash23:15:483
1129799120,1cyclictest27716-21grepconf.sh21:58:063
1129799120,1cyclictest12657-21sshd21:24:373
11296991211,0cyclictest17438-21grep23:36:452
11296991211,0cyclictest0-21swapper/223:23:152
1129699120,1cyclictest19576-21sshd22:45:242
1129699120,11cyclictest6332-21lspci22:50:342
1129699120,11cyclictest0-21swapper/223:28:342
1128999120,11cyclictest20139-21bash21:47:451
11284991210,1cyclictest0-21swapper/023:09:450
1128499120,11cyclictest22723-21bash00:06:450
1128499120,11cyclictest0-21swapper/000:25:450
11297991110,0cyclictest0-21swapper/323:29:583
1129799110,0cyclictest0-21swapper/300:08:383
1129699112,1cyclictest33-21ksoftirqd/223:00:222
11296991110,0cyclictest0-21swapper/222:59:142
1129699110,10cyclictest0-21swapper/221:38:042
1129699110,0cyclictest0-21swapper/223:57:152
1129699110,0cyclictest0-21swapper/200:17:552
1128999110,10cyclictest0-21swapper/123:49:551
1128999110,10cyclictest0-21swapper/122:28:051
1128999110,10cyclictest0-21swapper/100:22:251
1128999110,0cyclictest0-21swapper/100:29:341
1128499119,1cyclictest620-13audispd22:59:150
11284991110,0cyclictest0-21swapper/023:01:350
11284991110,0cyclictest0-21swapper/022:41:250
11284991110,0cyclictest0-21swapper/021:29:350
1128499110,10cyclictest0-21swapper/022:30:050
1128499110,10cyclictest0-21swapper/000:00:140
1129799109,0cyclictest9534-21sshd21:49:573
1129799109,0cyclictest0-21swapper/322:53:383
1129799109,0cyclictest0-21swapper/322:39:173
1129799109,0cyclictest0-21swapper/322:26:173
1129799109,0cyclictest0-21swapper/300:27:383
1129799100,0cyclictest0-21swapper/323:31:083
1129799100,0cyclictest0-21swapper/322:30:473
1129799100,0cyclictest0-21swapper/321:51:073
1129699109,0cyclictest0-21swapper/222:37:242
1129699109,0cyclictest0-21swapper/220:25:242
1129699109,0cyclictest0-21swapper/200:07:152
1129699108,1cyclictest33-21ksoftirqd/200:31:072
1129699108,1cyclictest29883-21sshd21:29:342
1129699100,0cyclictest0-21swapper/222:16:242
1129699100,0cyclictest0-21swapper/221:30:132
1129699100,0cyclictest0-21swapper/221:20:342
1128999109,0cyclictest0-21swapper/123:19:251
1128999109,0cyclictest0-21swapper/122:10:041
1128999108,1cyclictest2711-21bash21:36:251
1128999100,0cyclictest0-21swapper/100:06:251
1128499109,0cyclictest0-21swapper/023:20:550
1128499109,0cyclictest0-21swapper/022:50:350
1128499108,1cyclictest9-21ksoftirqd/023:51:540
1128499108,1cyclictest9-21ksoftirqd/023:51:540
1128499108,1cyclictest6091-21sshd21:36:450
1128499106,1cyclictest9-21ksoftirqd/023:31:310
1128499105,1cyclictest9-21ksoftirqd/023:43:380
3751290,0sleep30-21swapper/322:21:233
112979998,0cyclictest0-21swapper/322:05:473
112979998,0cyclictest0-21swapper/320:17:073
112979998,0cyclictest0-21swapper/300:02:083
112969998,0cyclictest0-21swapper/223:33:152
112969998,0cyclictest0-21swapper/221:46:542
112969997,1cyclictest33-21ksoftirqd/223:19:512
112969997,1cyclictest33-21ksoftirqd/223:05:372
112969997,1cyclictest33-21ksoftirqd/222:40:482
112969997,1cyclictest33-21ksoftirqd/221:50:262
112969997,1cyclictest33-21ksoftirqd/200:26:272
112969996,1cyclictest33-21ksoftirqd/200:12:212
112969993,2cyclictest700-21gdbus23:51:142
112969993,2cyclictest700-21gdbus23:51:132
112899998,0cyclictest26752-21sshd21:29:151
112899998,0cyclictest0-21swapper/123:51:051
112899998,0cyclictest0-21swapper/123:51:051
112899998,0cyclictest0-21swapper/123:05:551
112899998,0cyclictest0-21swapper/122:32:351
112899998,0cyclictest0-21swapper/122:16:051
112899998,0cyclictest0-21swapper/121:16:251
112899998,0cyclictest0-21swapper/121:13:151
112899998,0cyclictest0-21swapper/120:27:251
112849997,1cyclictest9-21ksoftirqd/022:00:020
112849997,1cyclictest9-21ksoftirqd/021:30:570
112849997,1cyclictest9-21ksoftirqd/000:20:300
112849995,1cyclictest9-21ksoftirqd/023:15:040
112849995,1cyclictest9-21ksoftirqd/022:20:410
112849995,1cyclictest9-21ksoftirqd/022:12:370
112849994,2cyclictest9-21ksoftirqd/021:42:100
112849994,1cyclictest9-21ksoftirqd/022:07:160
112849993,2cyclictest19311-21sshd23:49:530
6449280,1sleep3391rcuc/321:33:383
112979987,0cyclictest0-21swapper/321:29:073
112979986,1cyclictest964-21sshd00:38:173
112979986,1cyclictest7052-21grep21:17:313
112979986,1cyclictest18767-21lspci00:23:143
112979985,2cyclictest649-21avahi-daemon23:12:373
112969987,0cyclictest0-21swapper/220:12:242
112969987,0cyclictest0-21swapper/220:00:342
112969986,1cyclictest33-21ksoftirqd/223:45:182
112969986,1cyclictest33-21ksoftirqd/222:20:132
112969986,1cyclictest33-21ksoftirqd/221:40:022
112969986,1cyclictest33-21ksoftirqd/221:13:142
112899987,0cyclictest0-21swapper/122:51:251
112899986,1cyclictest5145-21grepconf.sh00:11:391
112899986,1cyclictest27352-21lspci21:58:051
112899985,2cyclictest649-21avahi-daemon23:39:301
112899985,2cyclictest649-21avahi-daemon23:35:001
112899985,2cyclictest649-21avahi-daemon21:54:211
112899985,2cyclictest19670-21sshd23:20:581
112849987,0cyclictest0-21swapper/020:10:150
112849986,1cyclictest9-21ksoftirqd/022:37:250
112849984,1cyclictest979-21sshd22:46:510
112849984,1cyclictest9-21ksoftirqd/021:55:110
112979976,0cyclictest0-21swapper/321:36:173
112979976,0cyclictest0-21swapper/300:15:083
112979975,1cyclictest648-21systemd-logind00:10:233
112979975,1cyclictest17787-21sshd22:45:153
112979975,1cyclictest17249-21sshd22:42:013
112979974,2cyclictest649-21avahi-daemon23:06:443
112979974,2cyclictest649-21avahi-daemon23:00:423
112979974,2cyclictest649-21avahi-daemon00:30:163
112969976,0cyclictest0-21swapper/220:56:442
112969975,1cyclictest33-21ksoftirqd/221:09:592
112969970,6cyclictest0-21swapper/220:36:542
112969970,6cyclictest0-21swapper/219:56:042
112899976,0cyclictest0-21swapper/122:20:151
112899974,2cyclictest700-21gdbus00:00:231
112899974,2cyclictest649-21avahi-daemon23:11:281
112899974,2cyclictest649-21avahi-daemon21:40:561
112899974,2cyclictest646-21dbus-daemon22:56:441
112899974,2cyclictest17299-21snmpd19:59:561
112979965,0cyclictest0-21swapper/319:16:573
112979964,1cyclictest29000-21sshd21:06:333
112979963,2cyclictest17299-21snmpd21:04:153
112979960,5cyclictest0-21swapper/320:26:363
112969965,0cyclictest0-21swapper/219:29:442
112969964,1cyclictest33-21ksoftirqd/219:50:002
112969960,5cyclictest0-21swapper/219:14:132
112969960,0cyclictest0-21swapper/220:24:042
112899965,0cyclictest13062-21kworker/1:019:31:101
112899964,1cyclictest684-21polkitd21:09:331
112899964,1cyclictest16768-21cat20:40:131
112849966,0cyclictest523-40kipmi020:23:040
112849965,1cyclictest9-21ksoftirqd/020:34:590
112849964,1cyclictest9-21ksoftirqd/019:44:590
112849964,1cyclictest9-21ksoftirqd/019:15:010
112849963,2cyclictest29799-21sshd21:06:530
112849963,2cyclictest19923-21sadc19:29:590
112849962,2cyclictest25998-21sshd21:02:240
112979954,0cyclictest0-21swapper/319:50:173
112979954,0cyclictest0-21swapper/319:43:273
112979954,0cyclictest0-21swapper/319:36:363
112979954,0cyclictest0-21swapper/319:21:073
112979953,1cyclictest20797-21cat20:50:143
112979953,1cyclictest20637-21mii-tool19:30:143
112979953,1cyclictest17299-21snmpd20:58:063
112979953,1cyclictest17299-21snmpd20:46:183
112979953,1cyclictest17299-21snmpd20:41:393
112979953,1cyclictest17299-21snmpd20:38:213
112979953,1cyclictest17299-21snmpd20:32:293
112979953,1cyclictest17299-21snmpd20:07:053
112979953,1cyclictest17299-21snmpd20:00:283
112979953,1cyclictest17299-21snmpd19:55:263
112979953,1cyclictest17299-21snmpd19:29:103
112979953,1cyclictest17299-21snmpd19:10:413
112979953,1cyclictest1109-21ntpd19:45:173
112979952,2cyclictest17299-21snmpd20:12:083
112979951,3cyclictest8216-21ls20:20:133
112969953,1cyclictest7923-21turbostat.cron20:19:592
112969953,1cyclictest17299-21snmpd21:00:422
112969953,1cyclictest17299-21snmpd20:31:082
112969953,1cyclictest17299-21snmpd20:06:472
112969953,1cyclictest17299-21snmpd19:51:332
112969953,1cyclictest17299-21snmpd19:35:012
112969953,1cyclictest17299-21snmpd19:20:282
112969953,1cyclictest1053-21lldpd19:30:042
112969952,1cyclictest121rcu_preempt20:50:192
112969950,4cyclictest18312-21/usr/sbin/munin20:45:202
112969950,1cyclictest16278-21/usr/sbin/munin20:40:122
112899955,0cyclictest9807-21kworker/1:120:37:281
112899955,0cyclictest19252-21kworker/1:021:01:201
112899955,0cyclictest13062-21kworker/1:020:20:081
112899955,0cyclictest13062-21kworker/1:020:01:381
112899955,0cyclictest13062-21kworker/1:019:36:441
112899953,1cyclictest20760-21sort20:50:151
112899953,1cyclictest17299-21snmpd20:45:211
112899953,1cyclictest17299-21snmpd20:30:081
112899953,1cyclictest17299-21snmpd20:15:551
112899953,1cyclictest17299-21snmpd20:10:081
112899953,1cyclictest17299-21snmpd20:07:471
112899953,1cyclictest17299-21snmpd19:54:161
112899953,1cyclictest17299-21snmpd19:45:461
112899953,1cyclictest17299-21snmpd19:26:421
112899953,1cyclictest17299-21snmpd19:20:101
112899953,1cyclictest17299-21snmpd19:16:511
112899953,1cyclictest11968-21cat19:10:151
112899952,2cyclictest17299-21snmpd20:55:031
112899950,4cyclictest0-21swapper/119:42:441
112849954,0cyclictest0-21swapper/019:54:150
112849953,1cyclictest26547-21gltestperf19:45:130
112849953,1cyclictest17299-21snmpd20:45:030
112849953,1cyclictest17299-21snmpd20:17:380
112849953,1cyclictest17299-21snmpd20:08:400
112849953,1cyclictest17299-21snmpd20:00:530
112849953,1cyclictest17299-21snmpd19:57:080
112849953,1cyclictest17299-21snmpd19:30:220
112849953,1cyclictest17299-21snmpd19:18:400
112849953,1cyclictest15097-21grep20:35:180
112849950,1cyclictest22948-21sed20:55:130
112849950,1cyclictest21213-21ntp_states20:50:180
112849950,1cyclictest17413-21grep19:20:230
112849950,1cyclictest16576-21grep20:40:130
112849950,1cyclictest10589-21/usr/sbin/munin20:25:160
112969942,1cyclictest24379-21cat19:40:132
112969942,1cyclictest14384-21expr19:15:142
112849942,1cyclictest22242-21cpuspeed_turbos19:35:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional