You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 19:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot8.osadl.org (updated Thu Nov 20, 2025 12:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1072964992421,1cyclictest0-21swapper/307:45:173
1072964992320,1cyclictest0-21swapper/308:55:013
1072964992219,1cyclictest0-21swapper/311:50:183
1072964992219,1cyclictest0-21swapper/310:35:003
1072964992111,7cyclictest1395398-21sleep10:54:593
1072964992018,1cyclictest0-21swapper/311:30:003
1072964991917,1cyclictest0-21swapper/311:45:013
1072964991916,1cyclictest0-21swapper/307:25:133
107296499186,7cyclictest11258002sleep307:50:123
1072964991815,1cyclictest0-21swapper/311:10:003
1072964991815,1cyclictest0-21swapper/310:10:203
1072964991815,1cyclictest0-21swapper/308:45:203
1072964991815,1cyclictest0-21swapper/308:30:143
107296499181,14cyclictest1306833-21turbostat10:00:013
107296499181,13cyclictest1269231-21taskset09:35:153
107296499181,13cyclictest1242598-21chrt09:20:113
107296499181,13cyclictest1113013-21sleep07:40:013
107296499181,12cyclictest1290965-21taskset09:50:023
1072964991714,1cyclictest0-21swapper/312:20:193
1072964991714,1cyclictest0-21swapper/311:55:133
1072964991714,1cyclictest0-21swapper/311:35:153
1072964991714,1cyclictest0-21swapper/309:03:433
1072964991714,1cyclictest0-21swapper/308:55:183
1072964991714,1cyclictest0-21swapper/308:25:313
1072964991714,1cyclictest0-21swapper/308:20:263
1072964991714,1cyclictest0-21swapper/307:15:203
1072964991714,1cyclictest0-21swapper/307:10:153
107296499171,13cyclictest1524897-21sleep12:15:003
107296499171,13cyclictest1484313-21taskset11:49:553
107296499171,13cyclictest1379624-21chrt10:45:123
107296499171,13cyclictest1277233-21chrt09:40:203
107296499171,12cyclictest1549497-21turbostat12:30:003
107296499171,12cyclictest1530664-21taskset12:15:213
107296499171,12cyclictest1442619-21taskset11:22:193
107296499171,12cyclictest1395398-21sleep10:59:553
107296499171,12cyclictest1378189-21taskset10:42:343
107296499171,12cyclictest1337100-21taskset10:15:373
107296499171,12cyclictest1188547-21taskset08:40:003
107296499171,12cyclictest1150624-21sleep08:10:003
1072964991613,1cyclictest0-21swapper/311:15:223
1072964991613,1cyclictest0-21swapper/310:25:183
1072964991613,1cyclictest0-21swapper/308:13:333
1072964991613,1cyclictest0-21swapper/307:55:153
107296499161,13cyclictest1557490-21turbostat12:34:593
107296499161,13cyclictest1515740-21chrt12:08:073
107296499161,13cyclictest1410932-21chrt11:03:303
107296499161,12cyclictest1419979-21taskset11:10:053
107296499161,12cyclictest1345175-21chrt10:20:393
107296499161,12cyclictest1315419-21taskset10:05:113
107296499161,12cyclictest1264000-21chrt09:30:213
107296499161,12cyclictest1250590-21taskset09:25:053
107296499161,12cyclictest1226441-21taskset09:10:093
107296499161,12cyclictest1194550-21taskset08:42:253
107296499161,12cyclictest1157230-21taskset08:15:163
107296499161,12cyclictest1144347-21turbostat08:05:003
107296499160,12cyclictest1369258-21chrt10:35:303
107296499157,5cyclictest11189612sleep307:40:543
1072964991513,1cyclictest0-21swapper/309:05:163
1072964991512,1cyclictest0-21swapper/312:00:183
1072964991512,1cyclictest0-21swapper/310:00:143
1072964991512,1cyclictest0-21swapper/307:32:313
107296499151,12cyclictest1241326-21chrt09:17:523
107296499151,11cyclictest1283066-21taskset09:45:133
107296499151,11cyclictest1087795-21taskset07:20:063
107296499150,12cyclictest1562985-21taskset12:35:213
107296499150,12cyclictest1452117-21taskset11:30:123
12089832141,6sleep11210298-21kthreadcore08:55:181
11119922141,10sleep21112034-21ntp_states07:35:212
15632892131,4sleep21563539-21users12:35:252
15313352135,2sleep2171rcu_preempt12:15:452
147598130,9rtkit-daemon1233092-21ssh09:12:351
147598130,7rtkit-daemon1540-21sendmail-mta10:47:162
12964192131,2sleep10-21swapper/109:50:371
12523252134,6sleep21254313-21kthreadcore09:25:172
147598120,8rtkit-daemon1530817-21mailstats12:15:231
147598120,8rtkit-daemon1393456-21ssh10:50:252
13532502121,8sleep21353258-21ssh10:25:442
10789122120,8sleep11078913-21sshd07:11:341
15230312110,9sleep11523032-21sh12:10:421
147598110,7rtkit-daemon1459808-21ssh11:34:512
147598110,7rtkit-daemon1107020-21diskstats07:35:140
147598110,7rtkit-daemon1093714-21taskset07:24:110
147598110,6rtkit-daemon476-21wpa_supplicant09:58:212
147598110,4rtkit-daemon214-21plymouthd07:30:510
147598110,3rtkit-daemon1072955-21cyclictest11:27:562
14463922110,8sleep01448386-21cut11:25:210
13698062110,7sleep11369812-21ssh10:36:491
13233952111,7sleep21323571-21gltestperf10:10:172
12974752111,8sleep21297483-21ssh09:51:582
12899932110,8sleep21289999-21ssh09:48:122
12103012110,8sleep21212406-21kthreadcore08:55:192
11388242115,3sleep11139759-21kernelversion08:00:161
15392482100,8sleep21539254-21ssh12:20:252
15162432100,7sleep21516251-21ssh12:09:122
147598100,6rtkit-daemon313-21systemd-udevd07:55:432
147598100,6rtkit-daemon1548276-21ssh12:27:101
147598100,6rtkit-daemon1540-21sendmail-mta11:20:512
147598100,6rtkit-daemon1250421-21latency_hist09:25:002
147598100,5rtkit-daemon476-21wpa_supplicant10:44:532
147598100,4rtkit-daemon1079349-21munin-node11:49:490
147598100,3rtkit-daemon720-21snmpd08:21:461
14202222100,7sleep21420366-21gltestperf11:10:132
14026372101,7sleep20-21swapper/210:58:062
13798972100,8sleep11379589-21/usr/sbin/munin10:45:151
12427612100,7sleep01242970-21smartctl09:20:140
12407312100,7sleep21240738-21sh09:16:312
12133812100,7sleep0295-21systemd-journal08:57:380
107296499108,1cyclictest0-21swapper/307:10:003
1551501290,6sleep01553450-21kthreadcore12:30:180
14759890,6rtkit-daemon515-21gmain08:46:081
14759890,6rtkit-daemon1079349-21munin-node08:33:001
14759890,6rtkit-daemon1079349-21munin-node08:14:581
14759890,5rtkit-daemon295-21systemd-journal08:27:311
14759890,5rtkit-daemon214-21plymouthd11:08:340
14759890,5rtkit-daemon1484645-21ssh11:50:070
14759890,5rtkit-daemon1370575-21ssh10:38:342
14759890,4rtkit-daemon1500841-21apt-get12:00:122
14759890,4rtkit-daemon1157329-21df08:15:151
14759890,3rtkit-daemon214-21plymouthd11:16:142
14759890,2rtkit-daemon214-21plymouthd11:37:252
1419606290,1sleep21188531-21kworker/2:2+mm_percpu_wq11:09:492
1394744290,1sleep10-21swapper/110:53:321
1360617291,5sleep21360682-21ntp_states10:30:202
1346894290,6sleep01346899-21sh10:24:410
1308711294,3sleep01310222-21kthreadcore10:00:180
1239740290,1sleep00-21swapper/009:15:210
1206426290,6sleep11206485-21ntp_states08:50:211
1114205290,6sleep21115291-21kthreadcore07:40:172
1107229290,6sleep11107748-21irqcore07:35:161
1557156280,6sleep21557161-21sh12:34:162
1555170280,5sleep11555293-21expr12:30:231
1515675280,6sleep11515677-21ssh12:07:541
14759880,4rtkit-daemon730-21ntpd10:20:122
14759880,4rtkit-daemon214-21plymouthd09:34:092
14759880,4rtkit-daemon214-21plymouthd08:43:201
14759880,4rtkit-daemon214-21plymouthd07:48:210
14759880,4rtkit-daemon1280709-21awk09:40:272
14759880,4rtkit-daemon1234464-21/usr/sbin/munin09:15:151
14759880,4rtkit-daemon1-21systemd10:17:182
14759880,4rtkit-daemon1-21systemd10:07:260
14759880,4rtkit-daemon1-21systemd09:35:532
14759880,3rtkit-daemon214-21plymouthd11:12:450
14759880,3rtkit-daemon1217514-21grep09:00:171
14759880,3rtkit-daemon1068040-21sed07:05:160
14759880,1rtkit-daemon0-21swapper/111:01:071
14759880,1rtkit-daemon0-21swapper/007:44:370
14759880,1rtkit-daemon0-21swapper/007:13:550
1474755280,6sleep11474763-21ssh11:42:021
1467191280,2sleep11467199-21ssh11:38:131
1289377280,1sleep00-21swapper/009:46:420
1248565280,2sleep10-21swapper/109:20:591
1213843281,4sleep21213876-21apt-get09:00:112
1099223280,5sleep21099396-21netstat07:25:192
1094333281,4sleep01094482-21df_inode07:25:130
1541922274,1sleep01459951-21kworker/0:2+kacpid12:25:120
1527866270,2sleep0171rcu_preempt12:15:190
1523230270,4sleep01523238-21ssh12:11:140
1502178270,5sleep11503264-21kthreadcore12:00:161
1498899270,1sleep20-21swapper/211:56:212
1487426271,3sleep21489478-21kthreadcore11:50:202
1476349270,5sleep10-21swapper/111:45:021
14759870,4rtkit-daemon730-21ntpd11:55:090
14759870,4rtkit-daemon1-21systemd11:04:200
14759870,4rtkit-daemon1-21systemd09:59:480
14759870,3rtkit-daemon730-21ntpd11:41:382
14759870,3rtkit-daemon295-21systemd-journal11:45:022
14759870,3rtkit-daemon214-21plymouthd11:15:030
14759870,3rtkit-daemon214-21plymouthd08:35:081
14759870,3rtkit-daemon214-21plymouthd08:05:311
14759870,3rtkit-daemon1533497-21cat12:20:111
14759870,3rtkit-daemon1220771-21sed09:05:131
14759870,3rtkit-daemon1-21systemd07:50:230
1473462271,3sleep01473547-21ntp_states11:40:190
1421469271,3sleep11423193-21tr11:10:161
1403499271,3sleep01403625-21latency_hist11:00:000
1382586270,5sleep01384547-21grep10:45:180
1378332273,2sleep0151ktimers/010:42:530
1323196270,4sleep01323232-21ssh10:10:150
1307353271,3sleep11307557-21gltestperf10:00:141
1305587271,1sleep1171rcu_preempt09:57:091
1288477271,3sleep11288716-21sed09:45:271
1280358270,5sleep00-21swapper/009:40:260
1266673271,3sleep11266710-21apt-get09:35:091
1258661271,3sleep11258695-21apt-get09:30:131
1207206270,1sleep20-21swapper/208:53:312
1170191270,1sleep00-21swapper/008:25:120
1139762270,5sleep20-21swapper/208:00:172
1137165270,4sleep01137229-21ntp_states07:55:170
1100560271,3sleep21100593-21apt-get07:30:112
1089236270,4sleep11091153-21tr07:20:161
1081523271,2sleep00-21swapper/007:15:150
1565260260,1sleep00-21swapper/012:39:220
1564948260,1sleep10-21swapper/112:38:391
1542799260,3sleep21543964-21tr12:25:152
1539398260,1sleep00-21swapper/012:20:480
1517567260,3sleep21517665-21irqcore12:10:152
1508849261,3sleep01509000-21df_inode12:05:130
1508112260,1sleep00-21swapper/012:04:040
1499717260,1sleep10-21swapper/111:58:211
1491266260,1sleep10-21swapper/111:52:221
1466361260,1sleep00-21swapper/011:36:190
1457290260,1sleep10-21swapper/111:30:231
1436301260,3sleep01436502-21hddtemp_smartct11:20:160
1434847261,3sleep11379273-21kworker/u16:2+xprtiod11:18:001
1418566260,1sleep10-21swapper/111:07:221
1411506260,1sleep20-21swapper/211:04:482
1402756260,1sleep10-21swapper/110:58:211
1362846260,1sleep10-21swapper/110:34:201
1362748260,1sleep00-21swapper/010:34:070
1350204261,2sleep00-21swapper/010:25:180
1337612260,4sleep11337620-21ssh10:16:541
1337390260,3sleep01337398-21ssh10:16:250
1320469261,3sleep20-21swapper/210:05:192
1320384262,2sleep134-21ksoftirqd/110:05:191
1313200260,1sleep20-21swapper/210:01:002
1298620260,1sleep00-21swapper/009:54:400
1275023260,3sleep11275062-21apt-get09:40:151
1272648260,1sleep00-21swapper/009:35:520
1264637260,1sleep00-21swapper/009:31:000
1256819260,1sleep10-21swapper/109:26:241
1234133261,3sleep01234373-21latency_hist09:15:010
1220122260,3sleep01220274-21df_inode09:05:110
1195473261,3sleep01196410-21irqstats08:45:160
1195196261,2sleep20-21swapper/208:45:142
1194746260,1sleep00-21swapper/008:44:550
1194059260,3sleep21194279-21unixbench_multi08:40:212
1188467261,2sleep20-21swapper/208:40:002
1188397260,1sleep00-21swapper/008:39:060
1169999260,3sleep21170032-21apt-get08:25:092
1169329260,1sleep00-21swapper/008:23:040
1162915260,1sleep00-21swapper/008:16:420
1150510260,1sleep00-21swapper/008:08:520
1150402260,1sleep20-21swapper/208:07:302
1119576261,3sleep21119719-21df07:45:152
1119540260,3sleep11119573-21apt-get07:45:141
1073470260,4sleep20-21swapper/207:10:162
1072052260,3sleep11072190-21sed07:05:221
14759850,1rtkit-daemon0-21swapper/207:53:012
1378743250,1sleep10-21swapper/110:43:501
1344569250,2sleep11344692-21tr10:20:211
1329010250,3sleep10-21swapper/110:10:361
1256085250,3sleep01256335-21users09:25:220
1233259250,3sleep21233267-21ssh09:12:582
1206706250,3sleep01206954-21awk08:50:240
1158099251,2sleep21159061-21kthreadcore08:15:192
1150885250,3sleep01150920-21grep08:10:130
1137993250,1sleep10-21swapper/107:58:591
1131717250,3sleep10-21swapper/107:53:511
1113655250,2sleep10-21swapper/107:40:171
1097316250,2sleep10-21swapper/107:25:181
1093451250,3sleep20-21swapper/207:20:492
1079576251,2sleep10-21swapper/107:15:041
1452127240,2sleep00-21swapper/011:30:140
1444068240,1sleep10-21swapper/111:25:091
1436503240,2sleep10-21swapper/111:20:171
1389141240,2sleep01390655-21kthreadcore10:50:190
1370364240,1sleep00-21swapper/010:38:050
1353181240,2sleep1214-21plymouthd10:25:351
1216836240,2sleep01218725-21latency09:00:170
1176263240,2sleep20-21swapper/208:30:112
1156621240,2sleep2214-21plymouthd08:11:392
1144333240,2sleep01144375-21systemd-run08:05:000
1106308240,3sleep10-21swapper/107:31:381
1087458240,3sleep20-21swapper/207:19:102
1067172240,1sleep20-21swapper/207:05:152
1225500230,1sleep20-21swapper/209:05:212
1178865230,1sleep00-21swapper/008:30:170
1163443230,1sleep20-21swapper/208:20:052
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional