You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 08:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot0.osadl.org (updated Fri Nov 21, 2025 00:45:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1386699340,33cyclictest0-21swapper/122:45:131
1386699230,5cyclictest0-21swapper/121:13:441
1386699230,18cyclictest0-21swapper/120:16:261
13870992212,0cyclictest0-21swapper/223:31:252
1387099220,19cyclictest15993-21fschecks_time23:00:152
1387099220,18cyclictest0-21swapper/223:50:272
13866992220,1cyclictest21-21ksoftirqd/100:24:131
1386599226,15cyclictest0-21swapper/019:53:070
13865992114,3cyclictest0-21swapper/020:58:070
13870992010,0cyclictest0-21swapper/200:24:082
1387099200,17cyclictest4538-21H212:26:332
1386699203,11cyclictest454-21plymouthd22:25:011
13866992017,2cyclictest4532-21H212:26:331
13866992014,5cyclictest0-21swapper/123:00:151
1386699200,19cyclictest823-21systemd-network19:13:011
1387099192,1cyclictest0-21swapper/221:20:012
1387099191,16cyclictest4538-21H212:26:332
1387099190,4cyclictest4536-21H212:26:332
1387099190,2cyclictest4528-21H212:26:332
1387099190,2cyclictest31466-21apache_processe21:35:132
1387099190,18cyclictest0-21swapper/222:52:142
1387099190,18cyclictest0-21swapper/222:32:352
1387099190,17cyclictest4538-21H212:26:332
1387099190,16cyclictest4528-21H212:26:332
1387099190,16cyclictest4528-21H212:26:332
1387099190,16cyclictest4523-21H212:26:332
13866991917,1cyclictest0-21swapper/121:59:111
13866991916,2cyclictest1428-21cron21:39:011
13866991916,1cyclictest0-21swapper/121:22:181
13866991916,1cyclictest0-21swapper/121:22:181
13866991914,4cyclictest823-21systemd-network21:02:451
1386699191,14cyclictest0-21swapper/121:48:181
1386599193,15cyclictest21211-21anvil20:22:580
13865991917,1cyclictest9-21ksoftirqd/023:49:330
13865991917,1cyclictest0-21swapper/022:18:480
13865991914,3cyclictest26575-21cpuspeed_turbos23:20:160
1386599191,17cyclictest0-21swapper/021:35:220
1386599190,2cyclictest4581-21H212:26:330
1387099182,1cyclictest184362chrt20:14:062
1387099182,15cyclictest22193-21chrt19:22:012
1387099182,15cyclictest0-21swapper/220:05:062
13870991815,2cyclictest4593-21H212:26:332
13870991815,2cyclictest0-21swapper/222:05:182
13870991814,3cyclictest0-21swapper/220:18:122
13870991814,2cyclictest19626-21/usr/sbin/munin23:05:242
1387099181,1cyclictest0-21swapper/220:00:522
1387099181,16cyclictest4530-21H212:26:332
1387099180,3cyclictest4535-21H212:26:332
1387099180,2cyclictest31138-21latency_hist19:40:012
1387099180,17cyclictest4538-21H212:26:332
1387099180,17cyclictest4534-21H212:26:332
1387099180,17cyclictest12374-21grep22:55:152
1387099180,15cyclictest4534-21H212:26:332
1386699182,15cyclictest4534-21H212:26:331
13866991816,1cyclictest21-21ksoftirqd/122:29:361
13866991815,2cyclictest7419-21grep19:55:011
13866991814,3cyclictest4593-21H212:26:331
13866991814,3cyclictest4581-21H212:26:331
13866991814,3cyclictest22880-21sendmail-msp21:20:011
1386699181,16cyclictest4523-21H212:26:331
1386699180,2cyclictest4528-21H212:26:331
1386699180,2cyclictest4523-21H212:26:331
1386699180,2cyclictest4523-21H212:26:331
1386699180,16cyclictest4538-21H212:26:331
1386699180,15cyclictest4523-21H212:26:331
13865991815,2cyclictest31073-21idleruntime20:35:160
13865991815,2cyclictest25644-21nfsd422:20:210
13865991815,2cyclictest19199-21expr19:15:230
13865991814,3cyclictest4526-21H212:26:330
13865991814,3cyclictest2238-21grep20:40:200
13865991814,3cyclictest15983-21fschecks_time23:00:150
1386599180,4cyclictest0-21swapper/020:29:550
1386599180,2cyclictest4538-21H212:26:330
1386599180,2cyclictest4536-21H212:26:330
1386599180,17cyclictest4581-21H212:26:330
1386599180,16cyclictest4581-21H212:26:330
1386599180,16cyclictest4526-21H212:26:330
1387099172,14cyclictest0-21swapper/221:54:182
13870991715,1cyclictest7221-21chrt19:52:442
13870991714,2cyclictest6570-21latency23:40:182
13870991714,2cyclictest4538-21H212:26:332
13870991714,2cyclictest4538-21H212:26:332
13870991714,2cyclictest4532-21H212:26:332
13870991714,2cyclictest1411-21lxd23:18:562
13870991713,3cyclictest4526-21H212:26:332
13870991713,2cyclictest26200-21cpuspeed_turbos21:25:142
1387099170,2cyclictest9524-21expr20:55:202
1387099170,2cyclictest4528-21H212:26:332
1387099170,2cyclictest28066-21expr20:30:202
1387099170,2cyclictest2452-21sendmail_mailqu20:40:242
1387099170,2cyclictest23478-21cut23:15:012
1387099170,2cyclictest21973-21expr22:15:152
1387099170,16cyclictest6391-21awk21:45:202
1387099170,16cyclictest4581-21H212:26:332
1387099170,16cyclictest4581-21H212:26:332
1387099170,16cyclictest4534-21H212:26:332
1387099170,16cyclictest4530-21H212:26:332
1387099170,16cyclictest4528-21H212:26:332
1387099170,16cyclictest4311-21cat20:45:162
1387099170,16cyclictest3134-21rtkit-daemon20:20:162
1387099170,16cyclictest29096-21ls21:30:162
1387099170,16cyclictest25746-21grep19:30:152
1387099170,16cyclictest1411-21lxd19:10:562
1387099170,16cyclictest0-21swapper/219:15:222
13866991715,1cyclictest0-21swapper/123:30:571
13866991714,2cyclictest4581-21H212:26:331
13866991714,2cyclictest4581-21H212:26:331
13866991714,2cyclictest4581-21H212:26:331
13866991714,2cyclictest4538-21H212:26:331
13866991714,2cyclictest4528-21H212:26:331
13866991714,2cyclictest3280-21pzem_energy19:45:201
13866991714,2cyclictest16607-21switchtime21:05:221
13866991714,2cyclictest13989-21fschecks_time20:05:151
13866991714,1cyclictest0-21swapper/122:00:041
13866991714,1cyclictest0-21swapper/100:05:211
13866991713,2cyclictest4528-21H212:26:331
1386699171,15cyclictest30460-21/usr/sbin/munin00:25:201
1386699171,15cyclictest27161-21chrt00:18:261
1386699171,15cyclictest0-21swapper/120:53:351
13866991711,4cyclictest0-21swapper/119:55:591
1386699170,2cyclictest5891-21vmstat00:35:241
1386699170,2cyclictest4528-21H212:26:331
1386699170,2cyclictest26562-21timerandwakeup20:25:231
1386699170,2cyclictest21584-21proc_pri19:20:181
1386699170,16cyclictest602-21apache_processe22:35:131
1386699170,16cyclictest4532-21H212:26:331
1386699170,16cyclictest4530-21H212:26:331
1386699170,16cyclictest4526-21H212:26:331
1386699170,16cyclictest32101-21timerandwakeup20:35:221
1386699170,16cyclictest31228-21kernelversion22:30:181
1386699170,16cyclictest26826-21awk19:30:191
1386699170,16cyclictest23734-21awk19:25:171
1386699170,16cyclictest1472-21lxd20:40:561
1386699170,16cyclictest10822-21cut20:00:161
1386699170,16cyclictest0-21swapper/120:24:171
13865991715,1cyclictest9-21ksoftirqd/000:20:450
13865991714,2cyclictest997-21thermald00:04:120
13865991714,2cyclictest4530-21H212:26:330
13865991714,2cyclictest4526-21H212:26:330
13865991714,2cyclictest17270-21nfsd422:05:180
1386599170,2cyclictest4538-21H212:26:330
1386599170,2cyclictest4532-21H212:26:330
1386599170,2cyclictest4523-21H212:26:330
1386599170,2cyclictest21585-21proc_pri19:20:190
1386599170,1cyclictest4523-21H212:26:330
1386599170,16cyclictest7197-21mailstats23:40:210
1386599170,16cyclictest464-21latency_hist00:30:010
1386599170,16cyclictest4593-21H212:26:330
1386599170,16cyclictest4534-21H212:26:330
1386599170,16cyclictest4528-21H212:26:330
1386599170,16cyclictest4528-21H212:26:330
1386599170,16cyclictest31141-21vmstat23:25:230
1386599170,16cyclictest31109-21date21:35:000
1386599170,16cyclictest20401-21proc_pri20:15:230
1386599170,16cyclictest10821-21tr20:00:150
1386599170,16cyclictest0-21swapper/019:48:000
1386599170,15cyclictest4528-21H212:26:330
13870991614,1cyclictest0-21swapper/220:25:182
13870991614,1cyclictest0-21swapper/219:55:082
13870991614,1cyclictest0-21swapper/219:25:182
13870991613,2cyclictest31325-21cpuspeed_turbos19:40:122
1387099160,1cyclictest0-21swapper/219:50:022
1387099160,15cyclictest7891-21nfsd420:50:202
1387099160,15cyclictest0-21swapper/221:24:122
1387099160,15cyclictest0-21swapper/221:24:112
13866991614,1cyclictest21652-21/usr/sbin/munin22:15:191
13866991614,1cyclictest0-21swapper/122:50:131
13866991614,1cyclictest0-21swapper/120:45:171
13866991614,1cyclictest0-21swapper/120:34:351
13866991614,1cyclictest0-21swapper/120:10:251
13866991614,1cyclictest0-21swapper/119:40:091
13866991614,1cyclictest0-21swapper/119:35:161
1386699160,1cyclictest0-21swapper/121:30:081
1386699160,15cyclictest18433-21sed19:15:191
1386699160,15cyclictest0-21swapper/122:55:151
13865991614,1cyclictest28772-21nfsd422:25:200
13865991614,1cyclictest23261-21awk21:20:140
13865991614,1cyclictest23261-21awk21:20:140
13865991614,1cyclictest13664-21apt-get19:10:120
13865991614,1cyclictest0-21swapper/023:10:160
13865991614,1cyclictest0-21swapper/021:10:210
13865991614,1cyclictest0-21swapper/021:05:190
13865991614,1cyclictest0-21swapper/020:05:130
13865991614,1cyclictest0-21swapper/019:55:150
13865991614,1cyclictest0-21swapper/019:40:090
13865991614,1cyclictest0-21swapper/019:25:140
13865991614,1cyclictest0-21swapper/000:35:160
13865991613,2cyclictest4530-21H212:26:330
1386599160,2cyclictest26112-21expr19:30:150
1386599160,2cyclictest16451-21cpuspeed_turbos20:10:170
1386599160,2cyclictest14297-21expr23:55:150
1386599160,1cyclictest0-21swapper/022:30:130
1386599160,15cyclictest9576-21cpuspeed_turbos22:50:140
1386599160,15cyclictest7092-21cat20:50:150
1386599160,15cyclictest4581-21H212:26:330
1386599160,15cyclictest3232-21grep21:40:180
1386599160,15cyclictest27508-21pzem_current21:25:200
1386599160,15cyclictest0-21swapper/022:40:170
1386599160,15cyclictest0-21swapper/019:35:160
13865991514,0cyclictest0-21swapper/021:15:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional