You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-17 - 07:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Wed Sep 17, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
319872650,0sleep00-21swapper/022:57:340
135442590,0sleep20-21swapper/223:28:372
145382570,0sleep30-21swapper/300:32:013
34002540,1sleep13397-21sshd21:15:341
262042540,1sleep226001-21sshd22:00:222
172242540,1sleep317219-21ntp_states21:20:183
57282520,0sleep00-21swapper/000:07:590
248442510,0sleep10-21swapper/123:13:211
150582510,1sleep015046-21sshd22:35:280
10042510,1sleep1999-21bash22:37:261
165792500,0sleep30-21swapper/322:22:343
80572490,0sleep30-21swapper/321:16:053
41542490,0sleep20-21swapper/221:58:142
250102490,0sleep10-21swapper/122:10:141
137382490,0sleep2311rcuc/222:05:502
61652480,0sleep30-21swapper/323:04:553
54362480,0sleep20-21swapper/222:28:012
50002480,0sleep10-21swapper/121:51:441
299882480,0sleep20-21swapper/200:14:272
177732480,2sleep22753799cyclictest23:02:462
2726824735,7sleep20-21swapper/219:07:562
156672470,0sleep10-21swapper/122:59:151
283092460,0sleep20-21swapper/200:37:422
130872460,0sleep00-21swapper/022:18:580
139382430,2sleep22753799cyclictest22:52:252
70932410,0sleep20-21swapper/222:48:162
2715923227,3sleep00-21swapper/019:06:380
272252309,7sleep30-21swapper/319:07:253
160632240,1sleep341-21ksoftirqd/322:35:353
2712822210,7sleep10-21swapper/119:06:151
67202190,0sleep06717-21sshd00:27:030
220372170,0sleep3391rcuc/322:53:183
216232170,0sleep2311rcuc/221:40:182
166902170,1sleep30-21swapper/300:05:343
279482160,1sleep327943-21lspci23:07:023
2753699150,14cyclictest0-21swapper/121:12:011
186272150,1sleep125-21ksoftirqd/121:40:051
121052150,0sleep30-21swapper/321:26:173
101232150,0sleep210121-21grep23:15:122
81152140,0sleep30-21swapper/323:24:493
61862140,1sleep125-21ksoftirqd/123:54:241
50462140,1sleep3391rcuc/321:38:443
293442140,0sleep10-21swapper/122:54:041
277262140,1sleep227728-21bash23:36:302
26862140,0sleep20-21swapper/200:34:332
93512130,0sleep30-21swapper/300:39:273
27536991311,1cyclictest7744-21kworker/1:221:36:541
27536991311,1cyclictest24135-21kworker/1:120:45:141
119252130,0sleep20-21swapper/223:31:422
2754299120,1cyclictest20033-21bash23:16:093
27537991210,1cyclictest21904-21sshd21:24:062
27537991210,1cyclictest17602-21cp00:28:262
27536991210,1cyclictest1946-21kworker/1:122:34:351
2753699120,11cyclictest0-21swapper/122:05:301
2753699120,11cyclictest0-21swapper/122:03:511
187982120,0sleep10-21swapper/122:22:471
2754299119,1cyclictest30909-21sshd21:31:293
2754299119,1cyclictest19500-21sshd23:45:393
27542991110,0cyclictest0-21swapper/323:57:493
2754299110,10cyclictest0-21swapper/322:45:093
2754299110,10cyclictest0-21swapper/322:33:583
2754299110,10cyclictest0-21swapper/319:55:483
2754299110,10cyclictest0-21swapper/300:11:093
2754299110,0cyclictest0-21swapper/300:22:093
2753799119,1cyclictest1697-21sshd21:28:352
27537991110,0cyclictest0-21swapper/223:44:262
27537991110,0cyclictest0-21swapper/223:44:252
27537991110,0cyclictest0-21swapper/222:18:062
2753799110,10cyclictest0-21swapper/223:12:062
2753799110,0cyclictest0-21swapper/222:37:162
2753699119,1cyclictest26105-21sshd23:46:211
27536991110,0cyclictest0-21swapper/123:36:401
27536991110,0cyclictest0-21swapper/121:29:211
2753699110,10cyclictest16974-21lspci23:02:411
2753699110,0cyclictest0-21swapper/100:31:301
2753599119,1cyclictest11928-21lspci21:23:040
2753599113,4cyclictest16020-21munin-run20:00:000
27535991110,0cyclictest0-21swapper/023:58:310
27535991110,0cyclictest0-21swapper/022:25:220
2753599110,10cyclictest0-21swapper/023:36:410
2753599110,10cyclictest0-21swapper/021:36:420
2753599110,10cyclictest0-21swapper/000:11:520
2753599110,0cyclictest0-21swapper/023:31:020
45932100,0sleep20-21swapper/200:18:552
2754299109,0cyclictest0-21swapper/323:30:183
2754299109,0cyclictest0-21swapper/323:27:293
2754299109,0cyclictest0-21swapper/320:47:083
2754299109,0cyclictest0-21swapper/300:29:393
2754299106,2cyclictest13370-21sshd23:12:093
2754299100,0cyclictest0-21swapper/321:48:493
2753799109,0cyclictest0-21swapper/223:55:262
2753799109,0cyclictest0-21swapper/221:52:362
2753799109,0cyclictest0-21swapper/221:47:062
2753799109,0cyclictest0-21swapper/221:12:562
2753799100,0cyclictest0-21swapper/223:09:152
2753699109,0cyclictest0-21swapper/123:58:301
2753699109,0cyclictest0-21swapper/123:42:211
2753699109,0cyclictest0-21swapper/123:42:201
2753699109,0cyclictest0-21swapper/121:08:411
2753699109,0cyclictest0-21swapper/120:30:211
2753599109,0cyclictest0-21swapper/023:42:220
2753599109,0cyclictest0-21swapper/023:42:210
2753599109,0cyclictest0-21swapper/023:15:420
2753599109,0cyclictest0-21swapper/023:07:120
2753599109,0cyclictest0-21swapper/022:50:520
2753599109,0cyclictest0-21swapper/022:13:510
2753599109,0cyclictest0-21swapper/021:55:310
2753599109,0cyclictest0-21swapper/021:31:010
2753599109,0cyclictest0-21swapper/000:21:410
2753599100,0cyclictest0-21swapper/023:10:010
2753599100,0cyclictest0-21swapper/023:02:420
2753599100,0cyclictest0-21swapper/021:26:320
2753599100,0cyclictest0-21swapper/019:30:320
2753599100,0cyclictest0-21swapper/000:31:320
275429998,0cyclictest0-21swapper/321:54:183
275429997,1cyclictest41-21ksoftirqd/322:02:423
275429990,0cyclictest0-21swapper/320:35:583
275379998,0cyclictest0-21swapper/223:54:152
275379998,0cyclictest0-21swapper/221:07:562
275379998,0cyclictest0-21swapper/220:19:562
275379998,0cyclictest0-21swapper/219:40:462
275379997,1cyclictest14543-21lspci00:24:032
275369999,0cyclictest15186-21kworker/1:023:28:201
275369998,0cyclictest0-21swapper/122:25:211
275369998,0cyclictest0-21swapper/121:46:111
275369998,0cyclictest0-21swapper/120:51:301
275369997,1cyclictest28394-21id00:21:401
275369997,1cyclictest25-21ksoftirqd/122:41:151
275369990,0cyclictest0-21swapper/120:26:301
275359998,0cyclictest0-21swapper/019:15:220
275359997,1cyclictest30362-21grep21:44:310
275359995,3cyclictest4236-21kworker/0:223:28:390
275359991,4cyclictest26192-21munin-run20:25:000
275359990,0cyclictest0-21swapper/019:37:310
11346290,0sleep30-21swapper/322:28:393
275429986,1cyclictest18631-21lspci21:43:183
275429984,3cyclictest649-21avahi-daemon22:55:353
275429984,3cyclictest16856-21sshd23:42:033
275429984,3cyclictest16856-21sshd23:42:023
275429980,0cyclictest0-21swapper/319:14:573
275379987,0cyclictest0-21swapper/221:16:152
275379987,0cyclictest0-21swapper/200:06:252
275379986,1cyclictest31988-21lspci22:30:382
275379984,3cyclictest649-21avahi-daemon23:46:032
275379983,3cyclictest32631-21sshd23:20:382
275369987,0cyclictest0-21swapper/123:15:411
275369987,0cyclictest0-21swapper/123:07:111
275369987,0cyclictest0-21swapper/121:58:501
275369987,0cyclictest0-21swapper/100:10:411
275369986,1cyclictest4354-21lspci21:32:041
275369986,1cyclictest25267-21kworker/1:123:21:231
275369986,1cyclictest25-21ksoftirqd/123:34:581
275369986,1cyclictest25-21ksoftirqd/121:20:201
275369986,1cyclictest25-21ksoftirqd/100:06:201
275369986,1cyclictest12620-21lspci00:27:501
275369986,1cyclictest10064-21lspci22:18:391
275369985,2cyclictest649-21avahi-daemon00:36:001
275359987,0cyclictest0-21swapper/023:46:220
275359987,0cyclictest0-21swapper/022:41:220
275359987,0cyclictest0-21swapper/022:31:210
275359987,0cyclictest0-21swapper/021:00:220
275359986,1cyclictest30770-21lspci22:20:400
275359986,1cyclictest21526-21lspci00:02:360
275359986,1cyclictest12197-21lspci21:19:520
275359985,2cyclictest649-21avahi-daemon22:01:390
275359985,2cyclictest649-21avahi-daemon21:46:290
275359985,2cyclictest15587-21kworker/0:123:52:250
275359984,3cyclictest24605-21kworker/0:121:54:470
275359980,4cyclictest22127-21munin-run20:15:000
275429976,0cyclictest0-21swapper/323:35:593
275429975,1cyclictest7713-21lspci22:11:483
275429975,1cyclictest649-21avahi-daemon22:06:273
275429975,1cyclictest649-21avahi-daemon00:15:113
275429975,1cyclictest16856-21bash22:15:573
275429972,2cyclictest619-17sedispatch23:50:193
275379976,0cyclictest0-21swapper/222:20:162
275379976,0cyclictest0-21swapper/221:35:562
275379974,1cyclictest5919-21sshd22:11:362
275379974,1cyclictest31119-21sshd21:31:302
275379974,1cyclictest26304-21sshd22:40:042
275379974,1cyclictest10192-21sshd22:55:192
275379972,4cyclictest616-13auditd00:00:012
275369975,1cyclictest25-21ksoftirqd/100:15:031
275369975,1cyclictest25-21ksoftirqd/100:00:331
275369971,1cyclictest121rcu_preempt22:45:201
275359975,1cyclictest700-21gdbus00:15:580
275359975,1cyclictest1316-21sshd22:47:390
275359974,2cyclictest7702-21sshd00:35:100
275359974,2cyclictest649-21avahi-daemon22:06:040
275359970,6cyclictest26703-21sshd21:10:530
21269270,0sleep30-21swapper/321:56:383
16292270,5sleep216522-21diskstats20:00:122
275429965,0cyclictest0-21swapper/319:50:183
275429965,0cyclictest0-21swapper/319:25:083
275429964,1cyclictest646-21dbus-daemon00:00:563
275429964,1cyclictest31230-21sshd22:40:283
275429964,1cyclictest24010-21sshd21:10:293
275429963,2cyclictest646-21dbus-daemon21:09:263
275429960,5cyclictest0-21swapper/320:31:193
275429960,5cyclictest0-21swapper/320:06:283
275429960,5cyclictest0-21swapper/319:21:373
275379965,0cyclictest0-21swapper/220:40:062
275379964,1cyclictest646-21dbus-daemon21:00:002
275379963,2cyclictest17299-21snmpd20:50:512
275379960,5cyclictest0-21swapper/221:01:252
275369965,0cyclictest0-21swapper/119:52:511
275369965,0cyclictest0-21swapper/119:11:301
275359963,2cyclictest646-21dbus-daemon21:06:590
275359963,2cyclictest443-21systemd-journal23:20:090
275359963,1cyclictest20105-21idleruntime-cro20:10:000
275429953,1cyclictest7450-21cat20:55:213
275429953,1cyclictest649-21avahi-daemon20:20:543
275429953,1cyclictest4714-21mii-tool20:50:153
275429953,1cyclictest4549-21cat19:30:183
275429953,1cyclictest17299-21snmpd20:25:073
275429953,1cyclictest17299-21snmpd20:15:183
275429953,1cyclictest17299-21snmpd20:10:563
275429953,1cyclictest17299-21snmpd20:00:513
275429953,1cyclictest17299-21snmpd19:46:103
275429953,1cyclictest17299-21snmpd19:40:053
275429953,1cyclictest17299-21snmpd19:16:023
275429953,1cyclictest1109-21ntpd19:35:213
275429952,2cyclictest17299-21snmpd20:40:253
275429950,3cyclictest9767-21sshd21:01:003
275379954,0cyclictest0-21swapper/219:21:152
275379953,1cyclictest649-21avahi-daemon19:35:452
275379953,1cyclictest30797-21cat19:15:172
275379953,1cyclictest20812-21cat20:10:132
275379953,1cyclictest17299-21snmpd20:46:042
275379953,1cyclictest17299-21snmpd20:37:302
275379953,1cyclictest17299-21snmpd20:22:192
275379953,1cyclictest17299-21snmpd20:06:362
275379953,1cyclictest17299-21snmpd19:59:242
275379953,1cyclictest17299-21snmpd19:50:572
275379953,1cyclictest17299-21snmpd19:30:142
275379953,1cyclictest17299-21snmpd19:26:532
275379953,1cyclictest17299-21snmpd19:10:552
275379953,1cyclictest1109-21ntpd20:30:162
275379953,1cyclictest1058-21sendmail20:25:302
275379950,1cyclictest10144-21/usr/sbin/munin19:45:182
275369954,0cyclictest0-21swapper/119:58:411
275369953,1cyclictest6800-21nfsd19:35:181
275369953,1cyclictest459-21hddtemp_smartct20:40:141
275369953,1cyclictest32432-21tr19:20:131
275369953,1cyclictest17299-21snmpd21:00:251
275369953,1cyclictest17299-21snmpd20:39:211
275369953,1cyclictest17299-21snmpd20:20:091
275369953,1cyclictest17299-21snmpd20:18:331
275369953,1cyclictest17299-21snmpd20:09:571
275369953,1cyclictest17299-21snmpd20:00:261
275369953,1cyclictest17299-21snmpd19:40:411
275369953,1cyclictest17299-21snmpd19:25:231
275369953,1cyclictest1049-21rpcbind20:14:261
275369952,2cyclictest29984-21cat19:15:011
275369950,0cyclictest0-21swapper/120:55:411
275369950,0cyclictest0-21swapper/119:30:311
275359953,1cyclictest992-21ntp_states20:40:170
275359953,1cyclictest617-17auditd19:41:570
275359953,1cyclictest17299-21snmpd20:58:470
275359953,1cyclictest17299-21snmpd20:50:240
275359953,1cyclictest17299-21snmpd20:30:010
275359953,1cyclictest17299-21snmpd20:17:320
275359953,1cyclictest17299-21snmpd20:01:260
275359953,1cyclictest17299-21snmpd19:45:170
275359953,1cyclictest17299-21snmpd19:27:310
275359953,1cyclictest17299-21snmpd19:12:280
275359951,3cyclictest1025-21switchtime19:20:200
275369943,0cyclictest0-21swapper/119:45:111
275359942,1cyclictest649-21avahi-daemon20:25:000
275359942,1cyclictest30721-21expr20:35:110
275359942,1cyclictest29672-21munin-node19:50:100
275359942,1cyclictest17299-21snmpd20:45:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional