You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 07:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Wed Nov 26, 2025 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
90183121010,1sleep00-21swapper/019:15:030
9851692480,1sleep10-21swapper/120:20:281
893548992910,4cyclictest2025-21snmpd21:06:230
893549992819,3cyclictest1068768-21sh21:25:011
89354899289,6cyclictest1151192-21tr22:10:310
893548992719,4cyclictest12249081systemd-run22:55:000
893548992617,8cyclictest1250812-21/usr/sbin/munin23:10:000
893548992613,9cyclictest1253938-21kthreadcore23:10:270
893548992613,12cyclictest1210849-21kthreadcore22:45:280
893549992522,2cyclictest1085972-21/usr/sbin/munin21:35:011
893548992520,4cyclictest1277146-21unin-run23:25:020
893548992516,7cyclictest0-21swapper/000:30:010
893548992514,10cyclictest1096570-21kthreadcore21:40:270
89354899251,3cyclictest1225922-21diskstats22:55:230
893548992512,5cyclictest835198rtkit-daemon00:14:430
893549992421,2cyclictest1198836-21grep22:40:001
893549992415,2cyclictest0-21swapper/121:50:011
893548992417,2cyclictest0-21swapper/023:30:030
893548992416,6cyclictest0-21swapper/020:25:010
893548992415,2cyclictest899558-21grep19:15:000
893548992411,5cyclictest1321477-21aten_repower_po23:50:200
893548992411,5cyclictest1123970-21kthreadcore21:55:270
893548992410,7cyclictest1342767-21tr00:00:300
89354899238,5cyclictest1286287-21apt-get23:30:200
89354899234,7cyclictest914446-21aten2.4-expect19:25:230
89354899234,6cyclictest1042901-21head21:10:220
89354899233,7cyclictest1060243-21telnet21:20:230
893548992316,2cyclictest950742-21munin-plugin-st19:55:000
893548992316,2cyclictest0-21swapper/022:45:010
893548992315,3cyclictest1071888-21kthreadcore21:25:270
893548992312,6cyclictest1338497-21latency_hist00:00:030
893548992312,6cyclictest1108525-21missed_timers21:45:300
89354899229,6cyclictest1078481-21gltestperf21:30:300
89354899228,7cyclictest1263140-21tr23:15:300
89354899228,7cyclictest1169127-21kthreadcore22:20:330
89354899228,7cyclictest1130039-21cut22:00:220
89354899227,8cyclictest1053396-21kthreadcore21:15:270
89354899227,7cyclictest1319776-21diskmemload23:48:180
89354899227,7cyclictest1190742-21aten2.4-expect22:35:220
89354899227,6cyclictest957226-21aten2.4-expect20:00:220
893548992215,3cyclictest1236838-21kthreadcore23:00:290
893548992215,3cyclictest1177466-21kthreadcore22:25:280
893548992215,3cyclictest1002760-21kthreadcore20:35:290
893548992214,3cyclictest1014911-21kthreadcore20:45:280
893548992214,3cyclictest0-21swapper/020:00:020
893548992210,5cyclictest0-21swapper/022:05:300
893550992118,1cyclictest0-21swapper/222:48:402
89354899219,5cyclictest1113376-21ssh21:50:270
89354899216,4cyclictest1301636-21diskmemload23:37:280
89354899213,4cyclictest994060-21aten2.4-expect20:30:220
89354899213,4cyclictest987860-21aten2.4-expect20:25:210
893548992114,3cyclictest970848-21kthreadcore20:10:310
893548992114,3cyclictest1089316-21kthreadcore21:35:340
893548992114,3cyclictest1025568-21kthreadcore20:55:270
893548992113,3cyclictest0-21swapper/019:25:010
893548992111,6cyclictest1375511-21kthreadcore00:20:290
89354999209,3cyclictest1303569-21munin-run23:40:011
893549992017,2cyclictest1364538-21latency_hist00:15:011
893549992011,2cyclictest170550irq/121-eno121:35:281
893548992014,2cyclictest976926-21kthreadcore20:15:270
893548992014,2cyclictest893547-21cyclictest00:15:280
893548992014,2cyclictest1033158-21kthreadcore21:00:290
893548992014,2cyclictest1008851-21kthreadcore20:40:280
893548992013,3cyclictest1348776-21kthreadcore00:05:270
302487291200,7phc2sys0-21swapper/323:15:213
893550991916,1cyclictest0-21swapper/223:30:022
893550991916,1cyclictest0-21swapper/221:40:002
89354999199,2cyclictest170550irq/121-eno122:25:011
893549991916,2cyclictest962993-21systemctl20:05:011
893549991916,2cyclictest1190063-21idleruntime-cro22:35:001
893549991916,2cyclictest0-21swapper/121:20:011
893549991912,2cyclictest170550irq/121-eno122:05:001
89354899193,4cyclictest1372696-21kworker/u16:0+rpciod00:30:050
893548991913,2cyclictest921968-21kthreadcore19:30:280
893548991913,2cyclictest1305315-21kthreadcore23:40:280
89354899190,5cyclictest1182088-21aten2.4-expect22:30:210
89354999183,7cyclictest1266374-21cron23:17:001
893549991815,2cyclictest914002-21cut19:25:011
89354899189,5cyclictest1403191-21grep00:35:300
302487291180,3phc2sys0-21swapper/322:00:593
302487291180,3phc2sys0-21swapper/300:17:203
302487291180,2phc2sys0-21swapper/319:05:223
89355099171,6cyclictest0-21swapper/222:00:012
89355099171,6cyclictest0-21swapper/219:30:012
893550991714,1cyclictest0-21swapper/222:20:002
89354999174,5cyclictest956986-21cat20:00:011
89354999171,9cyclictest1164407-21cat22:20:021
89354999171,6cyclictest1635-21dbus-daemon22:55:001
893549991714,2cyclictest931752-21mailstats19:35:331
89354999171,3cyclictest1355530-21latency_hist00:10:011
893549991713,3cyclictest947747-21kthreadcore19:50:281
893549991713,3cyclictest1176138-21sort22:25:271
893549991710,2cyclictest1276861-21idleruntime-cro23:25:001
89354999170,8cyclictest1338155-21latency_hist00:00:021
89354899175,8cyclictest1160881-21pmu-power22:15:300
893548991713,3cyclictest965749-21kthreadcore20:05:260
302487291171,5phc2sys0-21swapper/300:10:023
302487291170,3phc2sys0-21swapper/323:39:003
302487291170,2phc2sys0-21swapper/321:50:183
302487291170,2phc2sys0-21swapper/321:40:053
89355099168,3cyclictest0-21swapper/223:05:222
893550991614,1cyclictest0-21swapper/221:25:012
893550991613,1cyclictest0-21swapper/221:00:002
893550991613,1cyclictest0-21swapper/220:45:012
893550991613,1cyclictest0-21swapper/219:20:012
893550991613,1cyclictest0-21swapper/200:34:032
89354999168,2cyclictest170550irq/121-eno121:58:571
89354999168,2cyclictest170550irq/121-eno121:44:201
89354999164,2cyclictest170550irq/121-eno120:40:021
89354999161,8cyclictest1029986-21cat20:59:551
89354999161,7cyclictest1373126-21latency_hist00:20:021
89354999161,6cyclictest938604-21latency_hist19:45:011
893549991613,2cyclictest1661-21polkitd23:50:011
893549991613,2cyclictest1375531-21kthreadcore00:20:291
893549991613,2cyclictest1294624-21sh23:35:011
893549991613,2cyclictest1278748-21kthreadcore23:25:291
893549991613,2cyclictest1247614-21phc2sys23:05:321
893549991613,2cyclictest1235357-21kthreadcore23:00:281
893549991613,2cyclictest1046956-21kthreadcore21:10:291
893549991613,2cyclictest1041691-21timerwakeupswit21:05:321
893549991613,2cyclictest1019305-21irqrtprio20:50:271
893549991613,2cyclictest1006796-21gltestperf20:40:241
893549991612,2cyclictest1155589-21latency_hist22:15:011
893549991612,2cyclictest0-21swapper/123:45:001
89354999160,6cyclictest1120975-21cat21:55:021
893548991613,2cyclictest941082-21kthreadcore19:45:270
302487291168,2phc2sys0-21swapper/319:20:283
302487291161,7phc2sys0-21swapper/320:05:193
302487291160,3phc2sys0-21swapper/323:26:393
302487291160,2phc2sys0-21swapper/322:54:163
302487291160,2phc2sys0-21swapper/322:39:283
302487291160,2phc2sys0-21swapper/321:33:483
302487291160,2phc2sys0-21swapper/321:16:063
89355099151,3cyclictest0-21swapper/221:30:012
893550991513,1cyclictest0-21swapper/222:45:022
893550991512,1cyclictest0-21swapper/223:45:332
893550991512,1cyclictest0-21swapper/222:35:322
893550991512,1cyclictest0-21swapper/222:25:262
89354999155,3cyclictest170550irq/121-eno123:10:241
89354999155,2cyclictest170550irq/121-eno100:25:251
89354999154,3cyclictest944630-21latency_hist19:50:001
89354999153,3cyclictest0-21swapper/100:00:221
893549991512,2cyclictest903960-21kthreadcore19:15:251
893549991512,2cyclictest894108-21cpuspeed_turbos19:10:231
893549991512,2cyclictest1225342-21acpi22:55:191
893549991512,2cyclictest1207488-21idleruntime-cro22:45:011
893549991512,2cyclictest1139335-21gltestperf22:05:261
893549991511,3cyclictest1393980-21kthreadcore00:30:291
893549991511,3cyclictest1034076-21kthreadcore21:00:291
893549991510,3cyclictest1324358-21kthreadcore23:50:261
89354899151,7cyclictest0-21swapper/019:35:290
893548991512,2cyclictest893547-21cyclictest19:40:280
893548991511,3cyclictest1019263-21irqcore20:50:270
302487291155,2phc2sys0-21swapper/323:44:223
302487291150,4phc2sys0-21swapper/323:12:233
302487291150,2phc2sys0-21swapper/323:56:413
302487291150,2phc2sys0-21swapper/322:55:233
302487291150,2phc2sys0-21swapper/322:47:263
302487291150,2phc2sys0-21swapper/321:27:263
89355099141,6cyclictest0-21swapper/200:20:012
893550991412,1cyclictest0-21swapper/223:00:002
893550991412,1cyclictest0-21swapper/222:55:012
893550991412,1cyclictest0-21swapper/222:15:012
893550991412,1cyclictest0-21swapper/220:20:262
893550991412,1cyclictest0-21swapper/200:25:012
893550991411,1cyclictest0-21swapper/223:50:232
893550991411,1cyclictest0-21swapper/222:05:262
893550991411,1cyclictest0-21swapper/221:10:342
893550991411,1cyclictest0-21swapper/220:50:302
893550991411,1cyclictest0-21swapper/220:36:492
893550991411,1cyclictest0-21swapper/220:05:022
893550991411,1cyclictest0-21swapper/219:50:492
893550991411,1cyclictest0-21swapper/219:35:282
893550991411,1cyclictest0-21swapper/219:20:262
893550991411,1cyclictest0-21swapper/200:00:022
893550991410,2cyclictest0-21swapper/200:05:022
89355099140,1cyclictest0-21swapper/223:39:532
89355099140,1cyclictest0-21swapper/200:10:272
89354999149,4cyclictest1-21systemd20:32:141
89354999147,2cyclictest170550irq/121-eno121:26:241
89354999141,5cyclictest1209332-21/usr/sbin/munin22:45:261
89354999141,3cyclictest993558-21latency_hist20:30:011
893549991412,1cyclictest2009-21runrttasks20:10:241
893549991411,2cyclictest917092-21kthreadcore19:25:291
893549991411,2cyclictest893547-21cyclictest20:15:281
893549991410,3cyclictest1404655-21processes00:35:331
302487291145,2phc2sys0-21swapper/322:27:443
302487291140,2phc2sys0-21swapper/323:31:123
302487291140,2phc2sys0-21swapper/323:20:523
302487291140,2phc2sys0-21swapper/300:12:413
89355099139,2cyclictest0-21swapper/223:41:322
89355099131,4cyclictest0-21swapper/221:20:012
893550991311,1cyclictest0-21swapper/223:30:222
893550991311,1cyclictest0-21swapper/222:30:282
893550991311,1cyclictest0-21swapper/222:00:302
893550991311,1cyclictest0-21swapper/220:45:272
893550991310,1cyclictest0-21swapper/223:20:282
893550991310,1cyclictest0-21swapper/223:17:452
893550991310,1cyclictest0-21swapper/223:10:272
893550991310,1cyclictest0-21swapper/223:00:292
893550991310,1cyclictest0-21swapper/222:20:492
893550991310,1cyclictest0-21swapper/221:50:362
893550991310,1cyclictest0-21swapper/221:45:292
893550991310,1cyclictest0-21swapper/221:40:272
893550991310,1cyclictest0-21swapper/221:05:262
893550991310,1cyclictest0-21swapper/220:25:222
893550991310,1cyclictest0-21swapper/220:10:372
893550991310,1cyclictest0-21swapper/219:45:272
893550991310,1cyclictest0-21swapper/200:35:302
893549991310,2cyclictest921287-21fschecks_time19:30:251
893549991310,2cyclictest833295-21kworker/u16:2-events_power_efficient19:10:021
302487291134,2phc2sys0-21swapper/319:30:023
302487291132,2phc2sys0-21swapper/322:10:483
302487291130,2phc2sys0-21swapper/322:44:073
302487291130,2phc2sys0-21swapper/320:35:023
11641472130,8sleep30-21swapper/322:20:013
89355099129,2cyclictest0-21swapper/200:10:012
89355099129,1cyclictest0-21swapper/221:00:282
89355099129,1cyclictest0-21swapper/220:30:222
89355099129,1cyclictest0-21swapper/220:15:292
89355099129,1cyclictest0-21swapper/219:40:272
89355099129,1cyclictest0-21swapper/219:10:282
893550991210,1cyclictest0-21swapper/220:05:292
893550991210,1cyclictest0-21swapper/219:55:252
893550991210,1cyclictest0-21swapper/200:25:252
89354999129,2cyclictest964706-21kthreadcore20:05:251
89354999129,2cyclictest1017900-21true20:50:001
89354899129,2cyclictest804968-21kworker/u16:3-events_unbound19:10:010
302487291127,2phc2sys0-21swapper/323:55:013
302487291121,6phc2sys0-21swapper/321:10:213
302487291121,5phc2sys0-21swapper/320:55:203
302487291121,3phc2sys0-21swapper/323:04:553
302487291121,3phc2sys0-21swapper/319:40:203
302487291121,3phc2sys0-21swapper/300:20:533
302487291120,3phc2sys0-21swapper/322:34:563
302487291120,3phc2sys0-21swapper/322:05:433
302487291120,2phc2sys0-21swapper/321:58:483
302487291120,2phc2sys0-21swapper/321:05:193
302487291120,2phc2sys0-21swapper/320:32:173
302487291120,2phc2sys0-21swapper/319:12:073
302487291120,1phc2sys0-21swapper/320:23:323
89355099119,1cyclictest0-21swapper/221:30:322
89355099118,1cyclictest0-21swapper/219:30:282
302487291114,3phc2sys0-21swapper/319:35:013
302487291112,3phc2sys0-21swapper/319:38:073
302487291110,3phc2sys0-21swapper/321:20:223
302487291110,2phc2sys0-21swapper/300:36:023
302487291110,2phc2sys0-21swapper/300:00:233
302487291110,1phc2sys0-21swapper/320:51:373
89355099101,3cyclictest0-21swapper/219:10:012
302487291101,3phc2sys0-21swapper/320:20:013
302487291101,3phc2sys0-21swapper/319:50:013
302487291101,2phc2sys0-21swapper/319:15:033
302487291100,3phc2sys0-21swapper/320:40:353
302487291100,2phc2sys0-21swapper/323:49:153
302487291100,2phc2sys0-21swapper/323:08:303
302487291100,2phc2sys0-21swapper/322:21:023
302487291100,2phc2sys0-21swapper/321:45:443
302487291100,2phc2sys0-21swapper/320:25:323
302487291100,2phc2sys0-21swapper/320:00:233
302487291100,2phc2sys0-21swapper/300:30:443
302487291100,2phc2sys0-21swapper/300:26:593
30248729190,3phc2sys0-21swapper/321:00:023
30248729190,2phc2sys0-21swapper/321:35:053
30248729190,2phc2sys0-21swapper/320:10:333
30248729190,2phc2sys0-21swapper/319:55:233
30248729190,2phc2sys0-21swapper/319:50:023
30248729180,2phc2sys0-21swapper/320:45:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional