You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 09:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot0.osadl.org (updated Wed Nov 26, 2025 00:45:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10263992715,7cyclictest3642-21chrt21:49:321
1026399240,17cyclictest3275-21cat19:55:011
1026899236,11cyclictest0-21swapper/220:55:162
1026399232,6cyclictest15233-21date22:10:011
1026399230,8cyclictest10991-21grep20:05:171
1026399230,4cyclictest13711-21grep20:10:221
1026399230,3cyclictest28389-21awk19:40:181
1026399230,2cyclictest9410-21kernelversion21:00:191
1026399230,2cyclictest23809-21grep23:20:161
1026399230,2cyclictest13605-21chrt23:00:361
1026399230,2cyclictest1-21systemd22:25:011
1026399230,22cyclictest20282-21cut00:10:181
1026399230,22cyclictest0-21swapper/120:34:321
1026399230,1cyclictest0-21swapper/122:20:161
1025699232,15cyclictest17699-21python320:20:000
1026399220,3cyclictest2049-21systemd-journal23:47:481
1026399220,3cyclictest15773-21cat20:15:151
1026399220,2cyclictest32603-21expr22:40:151
1026399220,2cyclictest32212-21cut21:40:201
1026399220,2cyclictest32212-21cut21:40:201
1026399220,2cyclictest27721-21sed23:25:231
1026399220,2cyclictest24774-21expr19:35:151
1026399220,2cyclictest16245-21cstates00:05:141
1026399220,2cyclictest10967-21expr23:55:131
1026399220,21cyclictest435-21cut20:45:151
1026399220,21cyclictest29355-21dpkg22:35:121
1026399220,1cyclictest42482chrt23:41:051
1026399220,1cyclictest0-21swapper/123:15:141
1026399220,1cyclictest0-21swapper/120:00:131
1026399220,16cyclictest19366-21grep22:15:171
1026399220,16cyclictest14951-21if_err_eno121:10:171
1025699220,19cyclictest0-21swapper/020:06:030
10263992114,6cyclictest25333-21cat21:30:151
1026399210,2cyclictest8413-21grep23:50:141
1026399210,2cyclictest23971-21cat21:25:211
1026399210,2cyclictest1845-21systemd-journal00:21:091
1026399210,2cyclictest12802-21cron00:04:551
1026399210,20cyclictest0-21swapper/123:00:001
1026399210,20cyclictest0-21swapper/121:20:241
1026399210,1cyclictest319962chrt00:30:551
1026399210,1cyclictest17816-21sed21:15:171
1026399210,1cyclictest0-21swapper/123:05:151
1026399210,1cyclictest0-21swapper/122:31:011
1026399210,1cyclictest0-21swapper/122:10:201
1026399210,1cyclictest0-21swapper/121:55:131
1026399210,1cyclictest0-21swapper/121:05:131
1026399210,1cyclictest0-21swapper/120:56:211
1026399210,1cyclictest0-21swapper/120:55:011
1026399210,1cyclictest0-21swapper/120:40:121
1026399210,1cyclictest0-21swapper/120:25:181
1026399210,1cyclictest0-21swapper/119:55:171
1026399210,1cyclictest0-21swapper/119:25:161
1026399210,1cyclictest0-21swapper/119:15:131
1026399210,1cyclictest0-21swapper/100:39:001
1026399210,1cyclictest0-21swapper/100:15:151
1026399210,1cyclictest0-21swapper/100:15:151
1026399210,16cyclictest28077-21ps20:35:221
1026399210,16cyclictest17815-21sed19:20:211
1026399210,15cyclictest0-21swapper/121:55:021
10256992112,5cyclictest0-21swapper/019:45:170
1026899204,1cyclictest0-21swapper/220:23:352
10268992014,3cyclictest0-21swapper/223:50:122
10268992012,7cyclictest434-21systemd-udevd21:44:072
10268992012,7cyclictest434-21systemd-udevd21:44:072
1026399200,2cyclictest29736-21sed00:30:001
1026399200,1cyclictest18867-21awk23:10:181
1026399200,1cyclictest0-21swapper/123:35:141
1026399200,1cyclictest0-21swapper/119:10:231
1026399200,19cyclictest18823-21expr20:20:151
1026399200,19cyclictest0-21swapper/121:35:211
1026399200,19cyclictest0-21swapper/119:32:001
1026399200,15cyclictest29852-21nfsd423:30:181
1026399200,0cyclictest0-21swapper/122:50:121
10256992018,1cyclictest9-21ksoftirqd/022:16:000
1025699201,18cyclictest16657-21grep19:20:150
10268991913,5cyclictest0-21swapper/219:15:162
1026899190,3cyclictest4593-21H212:26:332
1026899190,18cyclictest0-21swapper/220:32:242
1026899190,17cyclictest4523-21H212:26:332
10263991913,5cyclictest0-21swapper/122:45:141
1025699193,15cyclictest9-21ksoftirqd/022:39:340
10256991917,1cyclictest0-21swapper/023:35:010
10256991916,2cyclictest0-21swapper/000:32:100
1025699190,16cyclictest4526-21H212:26:330
10268991816,1cyclictest28-21ksoftirqd/221:20:252
10268991816,1cyclictest0-21swapper/223:18:282
10268991815,2cyclictest25297-21tr21:30:152
10268991815,1cyclictest0-21swapper/220:25:182
10268991813,3cyclictest0-21swapper/200:08:012
1026899180,4cyclictest11857-21nfsd423:55:172
1026899180,3cyclictest11911-21cut19:10:192
1026899180,2cyclictest4776-21lxd21:36:572
1026899180,2cyclictest4538-21H212:26:332
1026899180,2cyclictest24809-21latency_hist21:30:012
1026899180,17cyclictest0-21swapper/223:10:222
10256991815,2cyclictest10835-21grep22:00:170
10256991815,1cyclictest0-21swapper/022:10:010
10256991814,3cyclictest4528-21H212:26:330
10256991814,3cyclictest4528-21H212:26:330
1025699180,3cyclictest9246-21awk22:00:010
1025699180,17cyclictest12121-21cron20:14:570
1025699180,16cyclictest0-21swapper/020:59:540
1026899172,1cyclictest5315-21cstates23:45:132
1026899172,1cyclictest0-21swapper/222:00:042
10268991715,1cyclictest240022sleep200:18:562
10268991715,1cyclictest240022sleep200:18:552
10268991715,1cyclictest0-21swapper/223:38:142
10268991714,2cyclictest4785-21/usr/sbin/munin21:50:162
10268991714,2cyclictest4536-21H212:26:332
10268991714,2cyclictest1995-21chrt21:45:182
10268991714,2cyclictest17884-21memory21:15:182
10268991714,2cyclictest1079-21gdbus00:25:202
10268991713,3cyclictest4526-21H212:26:332
10268991713,3cyclictest1079-21gdbus22:25:012
1026899171,1cyclictest0-21swapper/222:53:212
1026899171,15cyclictest5820-21taskset19:56:492
1026899171,15cyclictest17968-21timerwakeupswit19:20:222
1026899170,2cyclictest9969-21expr20:05:132
1026899170,2cyclictest9056-21chrt21:57:582
1026899170,2cyclictest4536-21H212:26:332
1026899170,2cyclictest4532-21H212:26:332
1026899170,2cyclictest31078-21cut20:40:202
1026899170,2cyclictest23452-21vmstat19:30:242
1026899170,2cyclictest15841-21latency_hist00:05:022
1026899170,16cyclictest967-21thermald22:40:232
1026899170,16cyclictest9057-21expr22:55:132
1026899170,16cyclictest4536-21H212:26:332
1026899170,16cyclictest4534-21H212:26:332
1026899170,16cyclictest4534-21H212:26:332
1026899170,16cyclictest3335-21nfsd423:40:182
1026899170,16cyclictest32405-21python300:35:022
1026899170,16cyclictest29529-21python319:45:022
1026899170,16cyclictest28247-21perf23:30:002
1026899170,16cyclictest26433-21chrt19:38:462
1026899170,16cyclictest25528-21grep00:20:172
1026899170,16cyclictest24541-21grep23:20:212
1026899170,16cyclictest0-21swapper/220:10:182
1026899170,16cyclictest0-21swapper/219:50:222
10256991715,1cyclictest0-21swapper/000:25:540
10256991714,2cyclictest4593-21H212:26:330
10256991714,2cyclictest4534-21H212:26:330
10256991714,2cyclictest4523-21H212:26:330
10256991714,2cyclictest3278-21expr20:50:150
10256991714,2cyclictest24271-21expr22:25:130
10256991714,2cyclictest17608-21munin-run22:15:000
10256991714,2cyclictest1169-21expr19:50:150
10256991713,3cyclictest0-21swapper/021:38:380
10256991713,2cyclictest0-21swapper/019:10:240
1025699171,15cyclictest4534-21H212:26:330
1025699170,2cyclictest7271-21cat20:00:150
1025699170,2cyclictest4528-21H212:26:330
1025699170,2cyclictest1930-21sed00:35:180
1025699170,16cyclictest4645-21nfsd422:45:170
1025699170,16cyclictest4538-21H212:26:330
1025699170,16cyclictest3350-21master21:18:180
1025699170,16cyclictest30865-21nfsd420:40:180
1025699170,16cyclictest27902-21nfsd420:35:190
1025699170,16cyclictest25787-21cut23:25:000
1025699170,16cyclictest20747-21/usr/sbin/munin22:20:180
1025699170,16cyclictest2049-21systemd-journal21:00:440
1025699170,16cyclictest11724-21grep23:00:140
1025699170,16cyclictest10622chrt23:36:480
10268991614,1cyclictest14508-21expr21:10:142
10268991614,1cyclictest0-21swapper/223:00:152
10268991614,1cyclictest0-21swapper/219:25:162
10268991614,1cyclictest0-21swapper/200:30:122
10268991613,2cyclictest3126-21expr20:50:152
1026899160,2cyclictest2292-21apt-get22:45:032
1026899160,15cyclictest9132-21fschecks_count21:00:162
1026899160,15cyclictest27195-21df22:30:132
1026899160,15cyclictest0-21swapper/223:30:162
1026899160,15cyclictest0-21swapper/223:05:162
1026899160,15cyclictest0-21swapper/222:05:202
1026899160,15cyclictest0-21swapper/219:45:042
10256991615,1cyclictest0-21swapper/019:55:180
10256991614,1cyclictest9952-21sed22:55:180
10256991614,1cyclictest19861-21cat21:20:160
10256991614,1cyclictest0-21swapper/023:50:200
10256991614,1cyclictest0-21swapper/023:25:160
10256991614,1cyclictest0-21swapper/022:30:130
10256991614,1cyclictest0-21swapper/021:25:130
10256991614,1cyclictest0-21swapper/021:10:160
10256991614,1cyclictest0-21swapper/020:25:160
10256991614,1cyclictest0-21swapper/019:35:150
10256991614,1cyclictest0-21swapper/000:05:170
10256991613,2cyclictest6135-21/usr/sbin/munin22:50:140
10256991613,2cyclictest23948-21grep20:30:140
1025699160,1cyclictest24840-21ls00:20:140
1025699160,1cyclictest0-21swapper/023:10:200
1025699160,1cyclictest0-21swapper/023:05:150
1025699160,1cyclictest0-21swapper/019:40:110
1025699160,15cyclictest24102-21sed19:35:020
1025699160,15cyclictest22537-21idleruntime00:15:150
1025699160,15cyclictest22537-21idleruntime00:15:150
1025699160,15cyclictest19038-21/usr/sbin/munin00:10:140
1025699160,15cyclictest1730-21awk21:45:150
1025699160,15cyclictest0-21swapper/023:45:190
1025699160,15cyclictest0-21swapper/023:40:210
1025699160,15cyclictest0-21swapper/023:15:090
1025699160,15cyclictest0-21swapper/022:40:150
1025699160,0cyclictest0-21swapper/000:00:040
1025699150,1cyclictest0-21swapper/021:50:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional