You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-03 - 09:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot0.osadl.org (updated Thu Jul 03, 2025 00:45:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2227993230,2cyclictest0-21swapper/222:20:192
2227993020,10cyclictest1534-21kworker/2:023:04:592
2227993019,10cyclictest0-21swapper/200:20:162
2227992423,0cyclictest0-21swapper/223:16:282
2227992423,0cyclictest0-21swapper/222:16:572
2227992423,0cyclictest0-21swapper/221:46:002
2227992423,0cyclictest0-21swapper/220:37:332
2227992422,1cyclictest1534-21kworker/2:023:49:222
2227992422,0cyclictest28-21ksoftirqd/200:05:522
2227992422,0cyclictest0-21swapper/220:21:232
2227992414,0cyclictest0-21swapper/222:28:522
2227992414,0cyclictest0-21swapper/221:56:572
2227992414,0cyclictest0-21swapper/221:39:492
2227992414,0cyclictest0-21swapper/221:17:112
222799233,13cyclictest21888-21munin-run19:45:012
2227992321,0cyclictest0-21swapper/223:41:362
2227992314,5cyclictest28-21ksoftirqd/219:54:362
2227992313,10cyclictest28-21ksoftirqd/200:04:242
2227992313,10cyclictest0-21swapper/220:13:032
2227992313,0cyclictest0-21swapper/223:38:412
2227992313,0cyclictest0-21swapper/220:48:542
2227992221,1cyclictest28-21ksoftirqd/221:50:182
2227992221,0cyclictest0-21swapper/222:11:152
2227992213,0cyclictest0-21swapper/220:03:172
2227992212,0cyclictest0-21swapper/223:26:062
2227992212,0cyclictest0-21swapper/220:52:152
2227992211,0cyclictest0-21swapper/221:30:502
221899220,0cyclictest0-21swapper/022:29:250
2227992112,9cyclictest0-21swapper/223:58:352
2227992111,0cyclictest0-21swapper/223:14:342
222299214,16cyclictest4538-21H212:26:331
2227992010,10cyclictest15923-21kworker/u16:100:10:412
2227992010,10cyclictest0-21swapper/223:31:252
2222992018,1cyclictest21-21ksoftirqd/123:33:421
222799194,14cyclictest0-21swapper/221:40:182
222799192,3cyclictest0-21swapper/223:20:082
222799190,18cyclictest4536-21H212:26:332
222799190,18cyclictest0-21swapper/222:33:282
222799190,18cyclictest0-21swapper/220:25:182
222799190,15cyclictest0-21swapper/222:45:172
222299192,16cyclictest0-21swapper/122:51:191
2222991917,1cyclictest21-21ksoftirqd/100:04:071
2222991917,1cyclictest0-21swapper/123:35:491
2222991917,1cyclictest0-21swapper/121:26:471
2222991916,2cyclictest4532-21H212:26:331
2222991913,5cyclictest0-21swapper/119:45:161
222299190,2cyclictest4523-21H212:26:331
222299190,2cyclictest3692-21master19:29:101
222299190,18cyclictest0-21swapper/122:56:101
222299190,18cyclictest0-21swapper/121:55:231
222299190,16cyclictest4534-21H212:26:331
222299190,16cyclictest4532-21H212:26:331
222299190,16cyclictest4523-21H212:26:331
2218991917,1cyclictest425-21wc21:05:000
2218991917,1cyclictest0-21swapper/022:55:590
2218991916,2cyclictest3150-21if_lxdbr020:10:170
2218991914,2cyclictest4528-21H212:26:330
2218991914,2cyclictest4526-21H212:26:330
221899190,1cyclictest0-21swapper/022:20:170
221899190,18cyclictest823-21systemd-network19:11:300
221899190,18cyclictest414-20systemd-journal20:49:560
221899190,18cyclictest0-21swapper/023:52:230
221899190,16cyclictest4528-21H212:26:330
221899190,15cyclictest0-21swapper/021:56:000
221899190,15cyclictest0-21swapper/020:01:390
2227991816,1cyclictest0-21swapper/219:49:562
2227991815,2cyclictest3079-21gmain20:44:102
2227991815,2cyclictest0-21swapper/221:00:242
2227991814,3cyclictest4536-21H212:26:332
222799180,3cyclictest0-21swapper/219:10:172
222799180,2cyclictest4581-21H212:26:332
222799180,2cyclictest4538-21H212:26:332
222799180,17cyclictest4530-21H212:26:332
222299182,1cyclictest17541-21taskset23:29:051
222299182,15cyclictest0-21swapper/122:15:171
222299182,15cyclictest0-21swapper/120:39:071
2222991816,1cyclictest0-21swapper/120:41:061
2222991815,2cyclictest4581-21H212:26:331
2222991815,2cyclictest31945-21which21:00:231
2222991815,2cyclictest23374-21grep21:45:141
2222991814,3cyclictest16542-21sshd00:23:491
2222991814,3cyclictest0-21swapper/121:44:331
2222991813,4cyclictest0-21swapper/120:12:131
222299181,16cyclictest8900-21smtpd21:17:491
222299181,16cyclictest8206-21tr20:20:141
222299181,16cyclictest0-21swapper/122:00:471
222299180,17cyclictest4526-21H212:26:331
221899182,15cyclictest0-21swapper/019:31:530
2218991815,2cyclictest4534-21H212:26:330
2218991815,2cyclictest0-21swapper/020:57:350
2218991813,2cyclictest4528-21H212:26:330
221899181,2cyclictest19244-21grep22:35:190
221899181,2cyclictest11895-21if_enp1s019:25:170
221899181,2cyclictest10842-21nfsd421:20:170
221899181,2cyclictest0-21swapper/020:42:150
2218991812,3cyclictest4536-21H212:26:330
221899181,16cyclictest7715-21latency21:15:190
221899181,16cyclictest20179-21seq23:32:570
221899180,3cyclictest24918-21perf19:50:010
221899180,2cyclictest4523-21H212:26:330
221899180,17cyclictest4523-21H212:26:330
221899180,17cyclictest0-21swapper/022:15:320
221899180,16cyclictest4538-21H212:26:330
221899180,15cyclictest4528-21H212:26:330
2227991715,1cyclictest133592chrt00:19:192
2227991714,2cyclictest5521-21uname21:10:232
2227991714,2cyclictest4581-21H212:26:332
2227991714,2cyclictest4530-21H212:26:332
222799170,2cyclictest4581-21H212:26:332
222799170,2cyclictest4538-21H212:26:332
222799170,2cyclictest4532-21H212:26:332
222799170,2cyclictest4530-21H212:26:332
222799170,2cyclictest4523-21H212:26:332
222799170,2cyclictest32048-21expr20:05:162
222799170,2cyclictest19853-21egrep00:30:152
222799170,1cyclictest1403-21lxd00:28:552
222799170,16cyclictest4532-21H212:26:332
222799170,16cyclictest4528-21H212:26:332
222799170,16cyclictest4523-21H212:26:332
222799170,16cyclictest22138-21apache_volume22:40:162
222799170,16cyclictest1086-21snmpd22:52:192
2222991715,1cyclictest21-21ksoftirqd/100:17:361
2222991714,2cyclictest9498-21/usr/sbin/munin21:20:131
2222991714,2cyclictest7132-21apt23:10:161
2222991714,2cyclictest6695-21missed_timers22:10:181
2222991714,2cyclictest532-21sed23:55:191
2222991714,2cyclictest5169-21sed21:10:201
2222991714,2cyclictest4581-21H212:26:331
2222991714,2cyclictest29151-21ls20:00:161
2222991714,2cyclictest27798-21ntp_states23:45:231
2222991714,2cyclictest12248-21/usr/sbin/munin20:25:211
2222991714,2cyclictest1042-21expr21:05:171
2222991712,4cyclictest11248-21smartctl23:15:191
2222991712,2cyclictest13916-21grep22:25:141
222299171,15cyclictest0-21swapper/123:03:141
222299170,2cyclictest8900-21ls19:20:151
222299170,2cyclictest4538-21H212:26:331
222299170,2cyclictest4526-21H212:26:331
222299170,2cyclictest4523-21H212:26:331
222299170,2cyclictest32358-21if_eno120:05:191
222299170,2cyclictest22600-21expr22:40:191
222299170,2cyclictest20470-21memory19:40:201
222299170,1cyclictest0-21swapper/122:22:091
222299170,16cyclictest4538-21H212:26:331
222299170,16cyclictest4538-21H212:26:331
222299170,16cyclictest4536-21H212:26:331
222299170,16cyclictest4530-21H212:26:331
222299170,16cyclictest4190-21nvmesmart_nvme019:10:181
222299170,16cyclictest27500-21smartctl19:55:151
222299170,16cyclictest25711-21taskset23:41:461
222299170,16cyclictest25655-21if_eno122:45:191
222299170,16cyclictest21708-21perf22:40:001
222299170,16cyclictest1086-21snmpd22:31:001
222299170,15cyclictest4538-21H212:26:331
2218991716,1cyclictest9-21ksoftirqd/023:43:360
2218991715,1cyclictest0-21swapper/023:45:240
2218991715,1cyclictest0-21swapper/022:45:250
2218991715,1cyclictest0-21swapper/019:55:160
2218991714,2cyclictest9629-21nfsd419:20:180
2218991714,2cyclictest4538-21H212:26:330
2218991714,2cyclictest4536-21H212:26:330
2218991714,2cyclictest3941-21acpi21:10:150
2218991714,2cyclictest21380-21sendmail_mailtr00:30:250
2218991714,2cyclictest19957-21cat19:40:150
2218991714,2cyclictest17651-21df_inode00:25:130
2218991714,2cyclictest16478-21grep23:25:170
2218991714,2cyclictest13833-21cut23:20:180
2218991714,2cyclictest10682-21find20:25:120
2218991713,3cyclictest1603-21lxd20:07:100
221899171,2cyclictest27259-21nfsd421:50:200
221899171,1cyclictest0-21swapper/020:35:130
221899170,2cyclictest4528-21H212:26:330
221899170,2cyclictest1048-21cstates23:00:160
221899170,16cyclictest9088-21which00:10:180
221899170,16cyclictest5658-21cat20:15:140
221899170,16cyclictest4593-21H212:26:330
221899170,16cyclictest4536-21H212:26:330
221899170,16cyclictest4536-21H212:26:330
221899170,16cyclictest4532-21H212:26:330
221899170,16cyclictest434-21systemd-udevd20:23:070
221899170,16cyclictest31927-21grep23:55:160
221899170,16cyclictest30245-21cut22:55:000
221899170,16cyclictest17730-21nfsd419:35:180
221899170,16cyclictest14274-21gpg-connect-age00:20:010
221899170,16cyclictest11649-21expr00:15:140
221899170,16cyclictest0-21swapper/023:15:110
221899170,15cyclictest0-21swapper/020:30:160
2227991614,1cyclictest0-21swapper/220:30:222
2227991614,1cyclictest0-21swapper/220:15:122
2227991614,1cyclictest0-21swapper/219:15:152
222799160,15cyclictest4528-21H212:26:332
2222991614,1cyclictest0-21swapper/119:51:211
222299160,15cyclictest16501-21/usr/sbin/munin19:35:161
222299160,15cyclictest0-21swapper/119:30:211
222299160,15cyclictest0-21swapper/100:30:001
2218991614,1cyclictest0-21swapper/019:51:120
221899160,2cyclictest21205-21expr23:35:160
221899160,1cyclictest0-21swapper/019:15:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional