You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 10:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Tue Nov 18, 2025 00:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
163472210157,27sleep00-21swapper/019:08:090
162892209173,24sleep30-21swapper/319:07:283
163272204164,26sleep20-21swapper/219:07:562
164362199160,26sleep10-21swapper/119:09:191
72462650,1sleep27243-21apt-get22:35:132
272212560,0sleep10-21swapper/120:35:241
132642220,0sleep10-21swapper/121:56:151
11672190,0sleep00-21swapper/023:55:580
298682150,1sleep028497-21/usr/sbin/munin23:05:230
101942150,0sleep20-21swapper/223:25:082
101942150,0sleep20-21swapper/223:25:072
52442130,0sleep30-21swapper/323:16:273
1658599120,9cyclictest0-21swapper/223:55:162
1658599119,1cyclictest21928-21grep22:55:162
1658599110,10cyclictest0-21swapper/222:15:462
1658099112,8cyclictest0-21swapper/021:40:150
1658099110,7cyclictest12977-21ssh22:41:430
234712100,0sleep30-21swapper/321:25:383
165859999,0cyclictest0-21swapper/223:16:142
165859998,1cyclictest28-21ksoftirqd/221:14:382
165859997,1cyclictest28-21ksoftirqd/222:42:172
165859997,1cyclictest28-21ksoftirqd/221:27:182
165859990,5cyclictest0-21swapper/220:10:132
165859990,4cyclictest0-21swapper/221:50:142
165859990,3cyclictest742-21runrttasks23:02:082
165899986,1cyclictest19110-21snmpd20:21:303
165899982,2cyclictest10305-21diskmemload22:35:143
165899981,3cyclictest10305-21diskmemload23:10:043
165899980,5cyclictest15374-21open_inodes21:15:183
165899980,4cyclictest10227-21apt-get23:25:143
165899980,4cyclictest10227-21apt-get23:25:143
165859986,1cyclictest60950irq/123-eno122:27:302
165859986,1cyclictest19110-21snmpd23:45:332
165859986,1cyclictest19110-21snmpd21:45:052
165849987,1cyclictest284602sleep122:19:441
165849982,4cyclictest200-21jbd2/sda2-800:30:521
165849980,5cyclictest63182sleep121:46:341
165849980,4cyclictest0-21swapper/122:55:141
165809986,1cyclictest9-21ksoftirqd/020:59:430
165809986,1cyclictest19110-21snmpd20:37:090
165809986,1cyclictest19110-21snmpd00:04:450
165809984,0cyclictest0-21swapper/000:10:210
165809981,6cyclictest30607-21unixbench_singl22:20:220
165809981,4cyclictest17995-21cron22:05:010
165809981,1cyclictest6551-1kworker/u9:122:38:590
165809980,7cyclictest9810-21ssh23:24:400
165809980,7cyclictest7658-21ssh21:50:070
165809980,7cyclictest30022-21ssh23:50:480
165809980,7cyclictest26814-21ssh00:33:150
165809980,7cyclictest13479-21munin-run23:30:010
165809980,7cyclictest13479-21munin-run23:30:000
165809980,6cyclictest18687-21hddtemp_smartct21:20:170
15587280,1sleep30-21swapper/300:16:363
32232270,0sleep20-21swapper/221:39:222
165899976,1cyclictest35-21ksoftirqd/321:20:213
165899976,1cyclictest19110-21snmpd21:42:023
165899976,1cyclictest19110-21snmpd21:35:483
165899976,1cyclictest19110-21snmpd21:09:163
165899976,1cyclictest19110-21snmpd19:32:083
165899975,1cyclictest19110-21snmpd20:51:103
165899973,1cyclictest10305-21diskmemload22:56:523
165899971,3cyclictest10305-21diskmemload21:56:253
165899971,0cyclictest0-21swapper/321:46:243
165899970,6cyclictest22894-21ssh00:27:063
165899970,6cyclictest10305-21diskmemload23:40:553
165899970,4cyclictest9991-21ssh21:52:043
165899970,4cyclictest0-21swapper/320:00:133
165899970,2cyclictest0-21swapper/322:00:413
165899970,2cyclictest0-21swapper/319:10:133
165899970,1cyclictest27901-21ssh22:17:563
165899970,1cyclictest25277-21/usr/sbin/munin00:30:183
165859977,0cyclictest0-21swapper/221:32:382
165859976,1cyclictest60950irq/123-eno123:20:102
165859976,1cyclictest60950irq/123-eno123:12:332
165859976,1cyclictest60950irq/123-eno100:32:342
165859976,1cyclictest60950irq/123-eno100:22:562
165859976,1cyclictest60950irq/123-eno100:00:152
165859976,1cyclictest271rcuc/219:14:592
165859976,0cyclictest60950irq/123-eno121:23:492
165859975,1cyclictest60950irq/123-eno122:50:122
165859975,1cyclictest60950irq/123-eno122:05:242
165859975,1cyclictest60950irq/123-eno119:50:012
165859975,1cyclictest60950irq/123-eno119:50:002
165859975,1cyclictest60950irq/123-eno100:15:162
165859975,1cyclictest28-21ksoftirqd/220:30:012
165859975,1cyclictest19110-21snmpd21:17:502
165859974,2cyclictest28-21ksoftirqd/200:14:482
165859973,2cyclictest254-21systemd-journal20:20:002
165859972,2cyclictest10305-21diskmemload23:30:112
165859971,5cyclictest8509-21sshd00:06:442
165859971,4cyclictest30745-21apt-get20:45:142
165859970,7cyclictest0-21swapper/221:55:242
165859970,6cyclictest19110-21snmpd00:35:212
165859970,6cyclictest0-21swapper/222:30:372
165859970,2cyclictest0-21swapper/219:30:122
165849972,3cyclictest0-21swapper/122:05:231
165849970,7cyclictest0-21swapper/100:35:151
165849970,4cyclictest0-21swapper/123:53:161
165849970,2cyclictest0-21swapper/123:46:231
165809976,1cyclictest9-21ksoftirqd/000:15:130
165809976,1cyclictest21798-21ssh21:25:170
165809976,1cyclictest19110-21snmpd19:55:270
165809976,1cyclictest18935-21munin-node00:20:110
165809976,1cyclictest14853-21cat23:30:150
165809975,1cyclictest803-21sshd22:58:100
165809975,1cyclictest1842-21ntp_states20:50:190
165809975,1cyclictest16109-21ssh21:15:550
165809975,0cyclictest10305-21diskmemload23:15:380
165809974,1cyclictest10305-21diskmemload22:53:150
165809971,6cyclictest26478-21ssh21:30:170
165809971,6cyclictest2508-21ssh23:13:580
165809971,5cyclictest803-21sshd20:16:430
165809971,5cyclictest25338-21/usr/sbin/munin22:15:190
165809970,6cyclictest4606-21ssh22:30:180
165809970,6cyclictest24893-21/usr/sbin/munin19:25:140
165809970,6cyclictest19487-21ntp_states22:05:200
165809970,6cyclictest0-21swapper/023:00:050
165809970,6cyclictest0-21swapper/021:11:060
165809970,6cyclictest0-21swapper/020:47:530
165809970,6cyclictest0-21swapper/019:10:190
165809970,6cyclictest0-21swapper/000:35:220
165809970,5cyclictest10305-21diskmemload21:35:240
165809970,4cyclictest0-21swapper/022:45:240
165809970,1cyclictest9008-21ssh00:08:170
165809970,1cyclictest254-21systemd-journal19:50:010
165809970,1cyclictest21483-21fschecks_count20:25:160
165809970,1cyclictest20902-21ssh00:25:160
165809970,1cyclictest10305-21diskmemload23:42:430
165809970,1cyclictest0-21swapper/022:25:160
165809970,1cyclictest0-21swapper/021:55:210
25572260,0sleep20-21swapper/219:25:182
165899966,0cyclictest10305-21diskmemload23:51:073
165899965,1cyclictest35-21ksoftirqd/322:45:213
165899965,1cyclictest32483-21ssh23:55:163
165899965,1cyclictest2723-21ntpq19:45:203
165899965,1cyclictest24394-21ssh22:12:593
165899965,1cyclictest24136-21sshd19:22:433
165899965,1cyclictest19110-21snmpd20:47:033
165899965,1cyclictest19110-21snmpd20:19:263
165899965,1cyclictest19110-21snmpd20:11:213
165899965,1cyclictest11817-21ssh00:10:533
165899965,1cyclictest10772-21ssh22:40:103
165899964,1cyclictest7748-21perf21:05:003
165899964,1cyclictest3934-21cat20:55:193
165899964,1cyclictest19110-21snmpd23:30:113
165899963,2cyclictest10305-21diskmemload22:31:063
165899963,1cyclictest254-21systemd-journal20:30:023
165899963,0cyclictest10305-21diskmemload23:47:253
165899962,1cyclictest8454-21users23:20:233
165899962,1cyclictest10305-21diskmemload23:00:383
165899962,1cyclictest0-21swapper/300:35:153
165899961,4cyclictest18772-21/usr/sbin/munin00:20:213
165899961,3cyclictest6789-21cstates00:05:133
165899960,3cyclictest0-21swapper/323:06:273
165899960,3cyclictest0-21swapper/322:06:503
165899960,3cyclictest0-21swapper/321:31:563
165899960,2cyclictest742-21runrttasks22:26:203
165899960,2cyclictest0-21swapper/323:35:583
165899960,1cyclictest0-21swapper/321:12:133
165899960,0cyclictest10305-21diskmemload22:24:563
165859966,0cyclictest60950irq/123-eno123:40:162
165859966,0cyclictest60950irq/123-eno123:05:022
165859966,0cyclictest60950irq/123-eno122:46:322
165859966,0cyclictest60950irq/123-eno121:40:102
165859966,0cyclictest60950irq/123-eno121:06:492
165859966,0cyclictest60950irq/123-eno120:51:092
165859966,0cyclictest60950irq/123-eno120:09:432
165859966,0cyclictest60950irq/123-eno119:20:142
165859965,1cyclictest60950irq/123-eno123:36:112
165859965,1cyclictest60950irq/123-eno122:10:142
165859965,1cyclictest60950irq/123-eno121:04:592
165859965,1cyclictest60950irq/123-eno119:55:222
165859965,1cyclictest60950irq/123-eno119:40:202
165859965,1cyclictest60950irq/123-eno119:40:202
165859965,1cyclictest28-21ksoftirqd/220:35:162
165859965,1cyclictest19110-21snmpd20:31:572
165859964,1cyclictest60950irq/123-eno123:50:162
165859964,1cyclictest60950irq/123-eno120:20:152
165859964,1cyclictest60950irq/123-eno119:35:222
165859964,1cyclictest60950irq/123-eno100:25:132
165859962,1cyclictest254-21systemd-journal20:44:552
165859960,6cyclictest0-21swapper/220:02:082
165859960,6cyclictest0-21swapper/219:15:112
165859960,4cyclictest0-21swapper/222:00:102
165859960,2cyclictest0-21swapper/222:20:062
165849965,1cyclictest21-21ksoftirqd/121:10:251
165849961,3cyclictest0-21swapper/119:15:111
165849961,2cyclictest0-21swapper/123:00:231
165849961,1cyclictest0-21swapper/121:50:231
165849960,6cyclictest0-21swapper/122:28:001
165849960,6cyclictest0-21swapper/121:43:421
165849960,6cyclictest0-21swapper/121:08:341
165849960,6cyclictest0-21swapper/120:28:041
165849960,6cyclictest0-21swapper/120:04:271
165849960,6cyclictest0-21swapper/100:15:161
165849960,6cyclictest0-21swapper/100:11:161
165849960,5cyclictest0-21swapper/122:32:451
165849960,5cyclictest0-21swapper/122:20:091
165849960,5cyclictest0-21swapper/121:15:161
165849960,4cyclictest0-21swapper/123:30:541
165849960,4cyclictest0-21swapper/121:20:131
165849960,2cyclictest0-21swapper/123:25:161
165849960,2cyclictest0-21swapper/123:25:151
165849960,2cyclictest0-21swapper/123:10:191
165849960,2cyclictest0-21swapper/120:40:131
165849960,2cyclictest0-21swapper/100:20:141
165849960,1cyclictest0-21swapper/123:05:171
165849960,1cyclictest0-21swapper/122:42:421
165849960,1cyclictest0-21swapper/121:35:211
165849960,1cyclictest0-21swapper/119:54:121
165849960,1cyclictest0-21swapper/100:25:481
165849960,0cyclictest0-21swapper/123:36:051
165809965,1cyclictest5646-21telnet21:00:130
165809965,1cyclictest364-21ntpq19:40:200
165809965,1cyclictest364-21ntpq19:40:200
165809965,1cyclictest20972-21ntpq19:15:170
165809965,1cyclictest19110-21snmpd20:12:390
165809965,1cyclictest18406-21cat23:35:170
165809964,1cyclictest4485-21cat21:45:130
165809964,1cyclictest19110-21snmpd20:43:130
165809960,6cyclictest0-21swapper/020:02:410
165809960,5cyclictest10305-21diskmemload22:10:050
165809960,5cyclictest0-21swapper/023:47:030
165809960,0cyclictest0-21swapper/020:30:180
165809960,0cyclictest0-21swapper/020:20:150
165809960,0cyclictest0-21swapper/020:05:110
165809960,0cyclictest0-21swapper/019:30:180
165899954,1cyclictest21229-21sensors19:15:193
165899954,1cyclictest19110-21snmpd20:41:103
165899954,1cyclictest19110-21snmpd19:37:583
165899952,1cyclictest254-21systemd-journal20:09:543
165899952,1cyclictest0-21swapper/319:30:003
165899951,3cyclictest0-21swapper/320:35:183
165899951,1cyclictest18824-21latency22:50:183
165899951,1cyclictest10305-21diskmemload00:00:123
165899950,3cyclictest8918-21gpgv19:59:593
165899950,3cyclictest31656-21/usr/sbin/munin19:40:243
165899950,3cyclictest31656-21/usr/sbin/munin19:40:233
165899950,0cyclictest0-21swapper/319:50:063
165859950,5cyclictest0-21swapper/220:59:522
165849952,1cyclictest0-21swapper/123:58:041
165849951,2cyclictest0-21swapper/121:00:161
165849951,1cyclictest0-21swapper/123:15:441
165849950,5cyclictest0-21swapper/123:42:511
165849950,5cyclictest0-21swapper/120:50:331
165849950,5cyclictest0-21swapper/120:45:301
165849950,5cyclictest0-21swapper/120:20:151
165849950,5cyclictest0-21swapper/120:15:061
165849950,4cyclictest0-21swapper/123:20:171
165849950,4cyclictest0-21swapper/119:25:181
165849950,3cyclictest0-21swapper/122:10:191
165849950,3cyclictest0-21swapper/120:05:131
165849950,2cyclictest0-21swapper/121:25:451
165849950,2cyclictest0-21swapper/120:55:151
165849950,2cyclictest0-21swapper/119:57:451
165849950,2cyclictest0-21swapper/119:15:001
165849950,2cyclictest0-21swapper/100:05:121
165849950,1cyclictest0-21swapper/122:50:121
165849950,1cyclictest0-21swapper/122:46:071
165849950,1cyclictest0-21swapper/121:30:211
165849950,1cyclictest0-21swapper/100:04:281
165809954,1cyclictest19110-21snmpd19:52:170
165809951,3cyclictest7749-21apt-get21:05:000
165809951,3cyclictest22242-21telnet19:20:140
165809950,4cyclictest29275-21/usr/sbin/munin19:35:180
165899942,1cyclictest21193-21grep20:25:153
165849943,1cyclictest0-21swapper/120:14:451
165849942,1cyclictest28932-21chrt19:33:461
165849940,4cyclictest0-21swapper/119:49:111
165849940,2cyclictest0-21swapper/122:35:141
165849940,1cyclictest0-21swapper/122:00:111
165849940,0cyclictest0-21swapper/120:30:191
165849931,1cyclictest0-21swapper/119:20:151
165849931,0cyclictest0-21swapper/119:35:181
165849930,1cyclictest0-21swapper/119:40:151
165849930,1cyclictest0-21swapper/119:40:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional