You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 16:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Tue Nov 25, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
278042920,0sleep10-21swapper/111:08:281
215372920,0sleep121534-21sshd11:42:401
165632690,0sleep20-21swapper/209:24:202
280292640,0sleep10-21swapper/111:39:521
243342630,0sleep10-21swapper/109:39:321
288362590,0sleep2321ktimersoftd/211:32:592
288362590,0sleep2321ktimersoftd/211:32:592
213402590,0sleep10-21swapper/112:10:151
40922560,0sleep20-21swapper/210:58:472
84452540,8sleep375550irq/24-eno1-rx-11:51:553
298552540,0sleep00-21swapper/010:26:100
257842540,0sleep30-21swapper/310:57:283
171812530,2sleep3297499cyclictest09:00:213
249412520,0sleep20-21swapper/210:18:542
180432520,1sleep1241ktimersoftd/111:31:511
180432520,1sleep1241ktimersoftd/111:31:501
260925136,13sleep20-21swapper/207:06:502
167832510,0sleep20-21swapper/212:39:482
175442490,0sleep00-21swapper/010:21:280
189722480,1sleep118971-21sshd11:28:341
29822410,0sleep10-21swapper/111:19:501
263223025,3sleep00-21swapper/007:07:080
28452287,7sleep30-21swapper/307:09:433
254922715,7sleep10-21swapper/107:06:051
28122210,1sleep02768-21sshd10:40:400
174002200,1sleep10-21swapper/107:41:281
253382190,0sleep2311rcuc/209:25:152
177362190,0sleep20-21swapper/211:17:462
2962991812,2cyclictest9-21ksoftirqd/010:14:590
226082180,1sleep0111rcuc/009:53:530
20052180,1sleep1231rcuc/109:55:101
163282180,0sleep20-21swapper/209:52:592
321852170,0sleep10-21swapper/110:54:381
100512170,2sleep3297499cyclictest11:44:543
78412160,2sleep1296999cyclictest10:20:251
69062160,1sleep16905-21bash12:28:471
31742160,0sleep20-21swapper/210:51:152
296299167,1cyclictest9-21ksoftirqd/011:18:440
296299165,2cyclictest9-21ksoftirqd/011:37:520
230502160,0sleep20-21swapper/210:32:242
203592160,0sleep00-21swapper/011:32:060
203592160,0sleep00-21swapper/011:32:050
50852150,1sleep05088-21bash12:31:530
300162150,0sleep20-21swapper/212:31:072
300002150,0sleep2311rcuc/209:14:342
297499150,1cyclictest0-21swapper/312:20:563
297399152,3cyclictest33-21ksoftirqd/212:08:482
296999150,1cyclictest121rcu_preempt10:15:001
296299155,3cyclictest9-21ksoftirqd/012:15:190
282832150,0sleep00-21swapper/011:43:240
247632150,0sleep30-21swapper/311:04:423
169272150,0sleep00-21swapper/009:16:440
70732140,0sleep10-21swapper/112:15:211
67932140,0sleep30-21swapper/310:34:133
62852140,1sleep3391rcuc/310:41:023
301132140,0sleep30-21swapper/310:08:583
297399144,2cyclictest33-21ksoftirqd/210:37:082
296999141,1cyclictest25-21ksoftirqd/110:31:111
296299145,1cyclictest9-21ksoftirqd/011:54:520
296299142,1cyclictest9-21ksoftirqd/011:47:120
290262140,0sleep20-21swapper/211:05:082
183102140,1sleep3401ktimersoftd/310:14:473
156202140,0sleep10-21swapper/109:31:151
98092130,1sleep09805-21lspci09:37:440
297499131,11cyclictest11197-21grepconf.sh10:38:093
297399135,5cyclictest33-21ksoftirqd/211:29:222
297399135,3cyclictest33-21ksoftirqd/211:23:572
297399134,2cyclictest33-21ksoftirqd/210:02:282
297399134,2cyclictest33-21ksoftirqd/209:36:362
297399133,3cyclictest7396-21sshd10:44:452
297399133,3cyclictest684-21polkitd09:58:302
297399133,3cyclictest646-21dbus-daemon12:14:122
297399130,11cyclictest0-21swapper/211:50:152
296999138,1cyclictest25-21ksoftirqd/110:15:441
296999136,1cyclictest25-21ksoftirqd/111:50:311
296999133,1cyclictest25-21ksoftirqd/109:54:121
296299135,1cyclictest9-21ksoftirqd/012:26:090
296299135,1cyclictest9-21ksoftirqd/010:36:220
296299134,2cyclictest9-21ksoftirqd/011:28:070
296299133,1cyclictest646-21dbus-daemon12:05:140
2962991313,0cyclictest9156-21kworker/0:008:40:070
2962991313,0cyclictest9156-21kworker/0:008:27:590
2962991312,0cyclictest9156-21kworker/0:008:10:290
174192130,0sleep10-21swapper/112:09:551
2974991210,1cyclictest12709-21lspci09:12:153
297499120,11cyclictest17077-21sshd12:06:363
297499120,11cyclictest0-21swapper/312:10:463
297399128,1cyclictest33-21ksoftirqd/211:10:322
297399124,3cyclictest33-21ksoftirqd/209:33:072
297399123,3cyclictest8586-21sshd09:41:192
297399123,3cyclictest684-21polkitd10:06:292
297399122,2cyclictest33-21ksoftirqd/210:13:412
297399121,3cyclictest13690-21cat10:45:192
297399121,2cyclictest33-21ksoftirqd/212:15:022
297399120,11cyclictest6764-21sshd11:58:442
296999127,1cyclictest25-21ksoftirqd/112:32:591
296999127,1cyclictest25-21ksoftirqd/111:58:251
296999127,1cyclictest25-21ksoftirqd/111:48:591
296999126,1cyclictest25-21ksoftirqd/112:04:541
296999126,1cyclictest25-21ksoftirqd/109:14:351
296999120,11cyclictest0-21swapper/112:21:341
296999120,0cyclictest121rcu_preempt11:10:321
296299126,3cyclictest9-21ksoftirqd/010:00:240
296299126,1cyclictest9-21ksoftirqd/010:15:000
296299125,1cyclictest9-21ksoftirqd/009:30:270
296299123,1cyclictest9-21ksoftirqd/011:55:190
296299123,1cyclictest9-21ksoftirqd/011:08:530
296299123,1cyclictest9-21ksoftirqd/009:44:590
2962991212,0cyclictest9156-21kworker/0:008:54:090
2962991212,0cyclictest9156-21kworker/0:008:31:470
2962991212,0cyclictest9156-21kworker/0:008:05:380
2962991212,0cyclictest9156-21kworker/0:007:57:070
2962991212,0cyclictest9156-21kworker/0:007:44:400
2962991212,0cyclictest9156-21kworker/0:007:22:270
296299120,1cyclictest9259-21sshd11:02:580
296299120,1cyclictest516-21bash12:21:180
296299120,1cyclictest0-21swapper/012:11:080
296299120,11cyclictest8954-21sshd09:23:270
177332120,0sleep30-21swapper/310:18:073
297499119,1cyclictest16633-21sshd11:24:553
2974991110,0cyclictest0-21swapper/310:51:353
297499110,1cyclictest0-21swapper/309:15:153
297499110,10cyclictest0-21swapper/312:32:563
297499110,10cyclictest0-21swapper/312:01:473
297399119,1cyclictest21708-21bash11:35:452
297399116,2cyclictest33-21ksoftirqd/212:25:182
297399115,2cyclictest33-21ksoftirqd/211:03:262
297399113,3cyclictest33-21ksoftirqd/210:25:322
297399113,2cyclictest33-21ksoftirqd/209:46:412
297399113,2cyclictest33-21ksoftirqd/209:17:102
297399112,3cyclictest649-21avahi-daemon12:23:062
297399112,3cyclictest33-21ksoftirqd/211:47:132
297399112,3cyclictest33-21ksoftirqd/210:20:502
2973991110,0cyclictest0-21swapper/209:07:532
297399110,10cyclictest0-21swapper/207:53:342
296999119,1cyclictest616-17auditd12:35:241
296999117,1cyclictest25-21ksoftirqd/111:00:001
296999116,1cyclictest25-21ksoftirqd/111:04:511
296999116,1cyclictest25-21ksoftirqd/110:00:451
296999116,1cyclictest25-21ksoftirqd/109:43:591
296999116,1cyclictest25-21ksoftirqd/109:29:141
296999116,1cyclictest25-21ksoftirqd/109:15:161
296999112,1cyclictest25-21ksoftirqd/110:46:381
296999110,10cyclictest0-21swapper/111:21:541
296999110,0cyclictest121rcu_preempt09:45:511
296299119,1cyclictest3388-21sshd10:05:580
296299116,1cyclictest9-21ksoftirqd/011:10:240
296299116,1cyclictest9-21ksoftirqd/010:45:110
296299115,1cyclictest9-21ksoftirqd/010:59:180
296299114,1cyclictest9-21ksoftirqd/012:00:340
296299114,1cyclictest9-21ksoftirqd/010:54:050
296299114,1cyclictest9-21ksoftirqd/009:49:070
296299113,1cyclictest9-21ksoftirqd/012:35:080
296299111,1cyclictest11498-21lspci09:56:050
2962991111,0cyclictest9156-21kworker/0:009:01:150
2962991111,0cyclictest9156-21kworker/0:008:55:330
2962991111,0cyclictest9156-21kworker/0:008:45:400
2962991111,0cyclictest9156-21kworker/0:007:48:170
2962991111,0cyclictest9156-21kworker/0:007:34:350
2962991111,0cyclictest9156-21kworker/0:007:13:170
296299110,0cyclictest0-21swapper/008:20:180
297499109,0cyclictest0-21swapper/311:59:563
297499109,0cyclictest0-21swapper/310:25:053
297499109,0cyclictest0-21swapper/309:58:563
297499109,0cyclictest0-21swapper/309:43:153
297499109,0cyclictest0-21swapper/309:33:263
297499108,1cyclictest6047-21lspci11:06:023
297499108,1cyclictest32275-21cp11:12:253
297499108,1cyclictest20789-21sshd10:49:453
297499108,1cyclictest19510-21sshd11:49:363
297499100,0cyclictest0-21swapper/311:36:573
297499100,0cyclictest0-21swapper/311:30:553
297499100,0cyclictest0-21swapper/311:30:553
297499100,0cyclictest0-21swapper/311:27:563
297399101,3cyclictest616-17auditd11:40:082
297399100,9cyclictest0-21swapper/208:49:432
297399100,3cyclictest24631-21bash12:00:342
297399100,0cyclictest0-21swapper/207:34:332
296999107,2cyclictest25-21ksoftirqd/110:05:081
296999105,1cyclictest25-21ksoftirqd/110:42:151
296999105,1cyclictest25-21ksoftirqd/110:35:401
296999105,1cyclictest25-21ksoftirqd/110:27:251
296999101,1cyclictest25-21ksoftirqd/109:22:221
296299109,0cyclictest0-21swapper/008:04:270
296299108,1cyclictest9-21ksoftirqd/011:22:320
296299108,1cyclictest9-21ksoftirqd/009:25:590
296299104,1cyclictest9-21ksoftirqd/010:32:080
296299102,1cyclictest9-21ksoftirqd/009:11:360
2962991010,0cyclictest9156-21kworker/0:008:15:410
2962991010,0cyclictest9156-21kworker/0:007:25:450
2962991010,0cyclictest9156-21kworker/0:007:16:560
29749998,0cyclictest0-21swapper/309:37:053
29749998,0cyclictest0-21swapper/309:26:453
29749998,0cyclictest0-21swapper/309:24:563
29739998,0cyclictest0-21swapper/207:40:032
29739994,2cyclictest33-21ksoftirqd/208:25:002
29629999,0cyclictest9156-21kworker/0:008:36:290
29629999,0cyclictest9156-21kworker/0:007:50:010
29629999,0cyclictest9156-21kworker/0:007:37:530
29749987,0cyclictest0-21swapper/310:20:563
29749987,0cyclictest0-21swapper/310:02:053
29749986,1cyclictest41-21ksoftirqd/309:51:213
29749986,1cyclictest10064-21lspci11:16:553
29749985,2cyclictest649-21avahi-daemon12:35:043
29739987,0cyclictest0-21swapper/208:50:232
29739982,2cyclictest9581-21dump-pmu-power07:24:592
29699980,1cyclictest25-21ksoftirqd/109:06:141
29629988,0cyclictest9156-21kworker/0:009:05:570
29749975,1cyclictest4957-21sshd12:25:073
29749974,2cyclictest700-21gdbus12:15:013
29749974,2cyclictest649-21avahi-daemon09:47:233
29749974,2cyclictest646-21dbus-daemon07:15:003
29739976,0cyclictest0-21swapper/207:49:332
29739973,2cyclictest9536-21sshd08:42:272
29739972,2cyclictest33-21ksoftirqd/209:05:002
29699971,2cyclictest121rcu_preempt08:10:011
29699971,1cyclictest25-21ksoftirqd/108:15:001
29699971,1cyclictest25-21ksoftirqd/107:39:591
29749965,0cyclictest0-21swapper/308:35:153
29749964,1cyclictest649-21avahi-daemon09:06:143
29739964,1cyclictest14542-21cat08:55:152
29739962,1cyclictest4948-21latency_hist07:14:592
29739962,0cyclictest4196-21grep08:30:142
29739961,3cyclictest0-21swapper/207:25:162
29739961,2cyclictest3748-21latency_hist08:30:002
29739960,3cyclictest6306-21hddtemp_smartct08:35:142
29739960,0cyclictest0-21swapper/208:16:342
29699964,1cyclictest25-21ksoftirqd/107:34:591
29699964,1cyclictest25-21ksoftirqd/107:30:001
29699964,1cyclictest25-21ksoftirqd/107:14:591
29699964,1cyclictest19586-21sshd07:48:261
29699960,5cyclictest0-21swapper/108:54:331
29699960,1cyclictest121rcu_preempt07:55:011
29749953,1cyclictest649-21avahi-daemon08:25:103
29749953,1cyclictest22484-21cat07:55:153
29749953,1cyclictest17299-21snmpd08:55:033
29749953,1cyclictest17299-21snmpd08:52:203
29749953,1cyclictest17299-21snmpd08:31:053
29749953,1cyclictest17299-21snmpd08:20:013
29749953,1cyclictest17299-21snmpd07:46:093
29749953,1cyclictest17299-21snmpd07:35:023
29749953,1cyclictest12294-21cat07:30:153
29749953,1cyclictest1058-21sendmail07:29:533
29749953,1cyclictest1053-21lldpd07:41:533
29749953,1cyclictest10336-21gltestperf08:45:123
29749952,2cyclictest9717-21sshd08:44:403
29749952,2cyclictest24809-21cut08:00:183
29749952,2cyclictest17299-21snmpd07:53:493
29749952,2cyclictest1-21systemd07:15:003
29749950,4cyclictest26205-21cpuspeed_turbos08:05:123
29749950,0cyclictest0-21swapper/308:15:363
29749950,0cyclictest0-21swapper/308:11:553
29739952,2cyclictest17299-21snmpd07:35:112
29739951,1cyclictest26374-21gltestperf08:05:152
29739951,1cyclictest22137-21cpuspeed_turbos07:55:122
29739950,3cyclictest28377-21diskstats08:10:122
29739950,2cyclictest0-21swapper/207:15:002
29739950,0cyclictest24307-21diskstats08:00:152
29699953,1cyclictest7860-21grep07:20:111
29699953,1cyclictest443-21systemd-journal07:20:001
29699953,1cyclictest17299-21snmpd08:55:271
29699953,1cyclictest17299-21snmpd08:46:121
29699953,1cyclictest17299-21snmpd08:25:431
29699953,1cyclictest17299-21snmpd08:17:041
29699953,1cyclictest17299-21snmpd08:00:091
29699953,1cyclictest17299-21snmpd07:57:271
29699951,2cyclictest25-21ksoftirqd/108:20:151
29699951,0cyclictest25-21ksoftirqd/108:40:131
29699950,1cyclictest7746-21latency_hist08:40:001
29699950,1cyclictest3198-21kworker/1:208:30:131
29699950,0cyclictest121rcu_preempt09:00:161
29749942,1cyclictest7881-21cpuspeed_turbos07:20:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional