You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 20:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Sat Nov 15, 2025 12:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
885786992815,1cyclictest0-21swapper/311:00:213
885786992611,12cyclictest957817-21turbostat08:05:013
885786992521,1cyclictest0-21swapper/311:40:003
885786992420,1cyclictest0-21swapper/308:10:003
885786992411,1cyclictest0-21swapper/307:35:133
885786992115,3cyclictest1120882-21sleep10:00:003
88578699201,14cyclictest1378020-21taskset12:40:013
88578699201,14cyclictest1240599-21taskset11:15:023
88578699201,13cyclictest1096648-21taskset09:45:013
147598200,10rtkit-daemon1192182-21ssh10:41:220
885786991916,1cyclictest0-21swapper/311:20:013
885786991916,1cyclictest0-21swapper/310:20:183
88578699191,13cyclictest1210146-21turbostat10:55:003
885786991815,1cyclictest0-21swapper/309:30:003
885786991815,1cyclictest0-21swapper/309:20:173
885786991815,1cyclictest0-21swapper/308:30:153
885786991814,1cyclictest0-21swapper/312:10:173
88578699181,13cyclictest1200851-21taskset10:47:033
88578699181,13cyclictest1045943-21chrt09:10:303
88578699181,12cyclictest1345740-21taskset12:20:013
88578699181,12cyclictest1345740-21taskset12:20:013
885786991714,1cyclictest0-21swapper/310:15:183
88578699171,13cyclictest1121150-21taskset10:00:073
88578699171,12cyclictest912860-21chrt07:27:593
88578699171,12cyclictest1356758-21taskset12:25:183
88578699171,12cyclictest1327522-21taskset12:05:463
88578699171,12cyclictest1164926-21taskset10:25:203
88578699171,12cyclictest1072309-21taskset09:30:023
88578699171,12cyclictest1013614-21taskset08:45:223
88578699161,8cyclictest1027166-21taskset08:59:573
885786991613,1cyclictest0-21swapper/311:40:193
885786991613,1cyclictest0-21swapper/310:40:223
885786991613,1cyclictest0-21swapper/309:45:203
885786991613,1cyclictest0-21swapper/308:50:233
88578699161,12cyclictest989115-21chrt08:29:023
88578699161,12cyclictest969698-21taskset08:10:233
88578699161,12cyclictest934334-21taskset07:45:183
88578699161,12cyclictest919282-21chrt07:31:043
88578699161,12cyclictest1362066-21taskset12:30:153
88578699161,12cyclictest1344065-21chrt12:16:363
88578699161,12cyclictest1305471-21taskset11:55:133
88578699161,12cyclictest1304378-21taskset11:53:203
88578699161,12cyclictest1263741-21chrt11:27:393
88578699161,12cyclictest1255584-21taskset11:22:183
88578699161,12cyclictest1210504-21taskset10:55:133
88578699161,12cyclictest1183117-21taskset10:35:213
88578699161,12cyclictest1176093-21taskset10:31:293
88578699161,12cyclictest1054931-21taskset09:17:433
88578699161,12cyclictest1039645-21taskset09:08:373
88578699161,11cyclictest906428-21taskset07:21:263
88578699161,11cyclictest891741-21chrt07:11:363
88578699161,11cyclictest1105056-21chrt09:50:133
88578699160,13cyclictest931965-21chrt07:40:253
88578699160,12cyclictest1226902-21taskset11:05:153
885786991512,1cyclictest0-21swapper/311:45:193
885786991512,1cyclictest0-21swapper/308:20:343
88578699151,12cyclictest1135408-21chrt10:06:203
88578699151,11cyclictest970606-21taskset08:15:083
88578699151,11cyclictest944620-21taskset07:50:553
88578699151,11cyclictest900254-21taskset07:18:103
88578699151,11cyclictest1319669-21taskset12:01:093
88578699151,11cyclictest1265049-21taskset11:30:033
88578699151,11cyclictest1142606-21taskset10:10:253
88578699151,11cyclictest1027448-21chrt09:00:123
88578699151,11cyclictest1008071-21chrt08:41:203
88578699150,12cyclictest950951-21chrt07:56:283
88578699150,12cyclictest1080427-21chrt09:35:023
88578699150,11cyclictest996022-21taskset08:35:113
147598150,1rtkit-daemon0-21swapper/010:53:480
147598140,4rtkit-daemon1217757-21kworker/u16:4-rpciod11:25:242
9010812130,9sleep2901605-21sed07:20:182
147598130,8rtkit-daemon1039406-21kworker/u16:4+xprtiod09:26:380
8947652121,5sleep10-21swapper/107:15:161
147598120,8rtkit-daemon1047131-21ssh09:13:240
147598120,7rtkit-daemon942423-21kthreadcore07:50:190
147598120,5rtkit-daemon1313506-21ssh12:00:120
13601302126,3sleep11360137-21sh12:26:211
13534132120,1sleep00-21swapper/012:24:400
13534132120,1sleep00-21swapper/012:24:400
11453832121,7sleep11145420-21apt-get10:15:131
11440322121,8sleep11144040-21ssh10:12:321
11368642120,4sleep01136872-21ssh10:09:430
10939842122,7sleep21094122-21ntp_kernel_err09:40:232
9277732110,8sleep0929664-21cut07:40:190
9074102110,2sleep00-21swapper/007:25:170
147598110,7rtkit-daemon295-21systemd-journal11:36:422
147598110,7rtkit-daemon1357001-21tr12:25:180
147598110,6rtkit-daemon1363225-21cut12:30:190
147598110,6rtkit-daemon1152876-21ssh10:19:272
147598110,3rtkit-daemon214-21plymouthd10:36:562
12957542110,9sleep21295760-21ssh11:47:002
12872502110,3sleep01287258-21ssh11:40:590
12295042110,8sleep21231578-21cut11:05:192
12262392110,8sleep01226458-21latency_hist11:05:010
12180272110,1sleep00-21swapper/010:59:360
10706122111,7sleep11070618-21ssh09:26:361
9463332100,7sleep0947438-21kthreadcore07:55:180
147598100,6rtkit-daemon295-21systemd-journal09:10:000
147598100,6rtkit-daemon1540-21sendmail-mta12:14:270
147598100,6rtkit-daemon1540-21sendmail-mta11:14:161
147598100,6rtkit-daemon1540-21sendmail-mta09:54:060
147598100,6rtkit-daemon1064142-21latency_hist09:25:012
147598100,2rtkit-daemon214-21plymouthd10:02:190
147598100,1rtkit-daemon0-21swapper/111:15:101
13392342100,7sleep11340959-21tr12:15:191
13114522101,2sleep0214-21plymouthd11:56:020
13045852102,6sleep11264078-21kworker/u16:5+xprtiod11:53:471
12410752101,5sleep01241130-21cut11:15:150
11621812100,7sleep01162357-21awk10:25:170
10752722105,3sleep01077340-21kthreadcore09:30:190
10723002101,6sleep21072308-21ssh09:30:022
10200802100,7sleep21020204-21mailstats08:50:222
984609290,7sleep2986231-21cut08:25:172
14759890,6rtkit-daemon720-21snmpd07:17:280
14759890,6rtkit-daemon1540-21sendmail-mta11:01:222
14759890,6rtkit-daemon1540-21sendmail-mta07:36:160
14759890,5rtkit-daemon935703-21cut07:45:190
14759890,5rtkit-daemon720-21snmpd07:07:052
14759890,5rtkit-daemon22110-21packagekitd09:20:340
14759890,5rtkit-daemon0-21swapper/212:37:062
14759890,4rtkit-daemon1104387-21ssh09:49:200
14759890,2rtkit-daemon214-21plymouthd09:58:570
1336389290,6sleep21336395-21ssh12:12:392
1281236290,6sleep21281289-21cpuspeed_turbos11:40:132
1247835290,6sleep21247841-21ssh11:18:092
1233045291,4sleep01233078-21apt-get11:10:140
1168787290,1sleep20-21swapper/210:28:202
1105018291,4sleep21105051-21apt-get09:50:132
1078314291,1sleep10-21swapper/109:30:401
1007541291,4sleep11007666-21python308:40:231
958055281,3sleep1958088-21apt-get08:05:131
14759880,4rtkit-daemon892181-21munin-node09:21:181
14759880,4rtkit-daemon892181-21munin-node08:03:230
14759880,4rtkit-daemon730-21ntpd12:08:470
14759880,4rtkit-daemon214-21plymouthd09:16:090
14759880,4rtkit-daemon214-21plymouthd08:13:580
14759880,4rtkit-daemon1280129-21ssh11:38:150
14759880,4rtkit-daemon1229573-21cat11:05:181
14759880,4rtkit-daemon1-21systemd08:46:480
14759880,4rtkit-daemon1017161-21cut08:50:170
14759880,3rtkit-daemon1343673-21ssh12:15:460
14759880,1rtkit-daemon0-21swapper/011:47:100
14759880,1rtkit-daemon0-21swapper/007:33:280
1272028280,4sleep21272036-21ssh11:33:162
1271577280,5sleep1730-21ntpd11:32:111
1264275280,1sleep00-21swapper/011:28:580
1257068281,3sleep11257107-21apt-get11:25:141
1256359280,1sleep00-21swapper/011:24:080
1224767281,4sleep11224775-21ssh11:01:371
1199430281,4sleep01199576-21/usr/sbin/munin10:45:210
1185653281,4sleep01185681-21munin-run10:40:000
1143154280,5sleep01039767-21diskmemload10:10:350
1135754280,6sleep21135762-21ssh10:07:122
1081742280,5sleep11081952-21kthreadcore09:35:171
1045362280,1sleep20-21swapper/209:10:222
1033357280,2sleep01033358-21pool-udisksd09:03:310
1026852280,6sleep0847573-21kworker/0:0+kacpid08:55:530
1015938280,5sleep11017067-21kthreadcore08:50:171
996024271,3sleep0996057-21apt-get08:35:130
974329271,3sleep2975605-21memory08:15:202
944937270,4sleep2944962-21munin-run07:55:012
908123270,5sleep1909233-21kthreadcore07:25:181
904498270,4sleep1905675-21memory07:20:211
891191270,5sleep0891316-21python307:10:220
881105271,3sleep1882796-21cut07:05:181
879702270,2sleep00-21swapper/007:05:130
14759870,4rtkit-daemon892181-21munin-node08:30:080
14759870,4rtkit-daemon730-21ntpd09:25:212
14759870,4rtkit-daemon729-21lldpd10:55:512
14759870,4rtkit-daemon22110-21packagekitd08:08:440
14759870,3rtkit-daemon892181-21munin-node08:19:330
14759870,3rtkit-daemon730-21ntpd11:24:312
14759870,3rtkit-daemon729-21lldpd08:20:030
14759870,3rtkit-daemon214-21plymouthd10:30:132
14759870,3rtkit-daemon214-21plymouthd08:26:140
14759870,3rtkit-daemon1255739-21ssh11:22:391
14759870,3rtkit-daemon1-21systemd09:41:370
14759870,3rtkit-daemon1-21systemd08:43:270
14759870,3rtkit-daemon1159996-21ssh10:22:070
14759870,2rtkit-daemon214-21plymouthd09:39:020
1359185270,1sleep20-21swapper/212:25:232
1337407270,4sleep11337415-21ssh12:14:591
1320411270,4sleep11320419-21ssh12:03:011
1299386270,4sleep01301360-21tr11:50:210
1297341271,3sleep21297378-21apt-get11:50:152
1281192271,3sleep11281231-21apt-get11:40:121
1279427270,1sleep10-21swapper/111:36:371
1195107270,4sleep11195928-21kthreadcore10:45:181
1171226270,5sleep00-21swapper/010:30:180
1159469270,1sleep10-21swapper/110:20:541
1121666270,4sleep21122409-21cut10:00:192
1119298270,5sleep10-21swapper/109:56:261
1113127270,4sleep21113159-21apt-get09:55:142
1094264270,1sleep10-21swapper/109:40:261
1053844271,3sleep21048179-21/usr/sbin/munin09:15:432
1053525270,4sleep11053533-21ssh09:15:381
988624260,3sleep1988822-21users08:25:251
982704260,1sleep10-21swapper/108:21:521
972325261,3sleep1974328-21grep08:15:191
969584260,1sleep20-21swapper/208:10:232
964374260,3sleep1964526-21df_inode08:10:141
951226260,3sleep2951246-21apt-get08:00:012
940024260,4sleep1941192-21cat07:50:181
938423260,1sleep10-21swapper/107:46:461
932060260,1sleep1171rcu_preempt07:40:491
925781260,1sleep20-21swapper/207:38:372
913534260,1sleep10-21swapper/107:30:111
909238261,3sleep2911312-21tr07:25:192
885946260,3sleep20-21swapper/207:10:122
14759860,3rtkit-daemon720-21snmpd07:20:490
14759860,2rtkit-daemon1153995-21irqcore10:20:182
1372181260,4sleep11374214-21kthreadcore12:35:231
1370066260,1sleep00-21swapper/012:35:050
1369640260,4sleep11369648-21ssh12:34:421
1345827260,3sleep21345863-21apt-get12:20:132
1345827260,3sleep21345863-21apt-get12:20:132
1344112260,1sleep20-21swapper/212:16:482
1321575260,1sleep20-21swapper/212:05:062
1313923261,3sleep2214-21plymouthd12:00:172
1296370260,1sleep10-21swapper/111:48:271
1265088261,2sleep00-21swapper/011:30:170
1240550260,3sleep21240598-21ssh11:15:012
1216310260,1sleep10-21swapper/110:55:321
1205313261,3sleep21207371-21tr10:50:202
1192668260,1sleep20-21swapper/210:42:312
1186170261,2sleep11185966-21/usr/sbin/munin10:40:181
1183707260,3sleep11183709-21ssh10:35:281
1175827260,1sleep10-21swapper/110:30:551
1168286260,4sleep11168294-21ssh10:27:071
1152590260,1sleep00-21swapper/010:18:480
1138164260,3sleep21139060-21grep10:10:172
1135694260,1sleep10-21swapper/110:07:001
1111975260,1sleep10-21swapper/109:53:131
1039489260,1sleep10-21swapper/109:06:361
1028851261,2sleep10-21swapper/109:00:191
1027018260,1sleep10-21swapper/108:58:021
1008001260,4sleep20-21swapper/208:40:282
1001836260,1sleep10-21swapper/108:37:161
995330250,1sleep10-21swapper/108:32:501
990851250,3sleep2992382-21cat08:30:182
977149250,3sleep20-21swapper/208:20:172
956896250,3sleep1956952-21ntp_states08:00:201
951074250,3sleep20-21swapper/207:58:052
945378250,3sleep1945405-21fschecks_count07:55:151
938533250,3sleep20-21swapper/207:48:112
931709250,2sleep20-21swapper/207:40:252
925770250,1sleep10-21swapper/107:38:281
916281250,3sleep20-21swapper/207:30:202
895129250,3sleep2896064-21kthreadcore07:15:172
892006250,3sleep1892030-21munin-run07:15:001
879695250,2sleep30-21swapper/307:05:093
1328229250,2sleep11328237-21ssh12:07:251
1311585250,3sleep10-21swapper/111:56:191
1310527250,3sleep21310684-21ssh11:55:202
1226578250,2sleep00-21swapper/011:05:130
1200494250,3sleep244-21ksoftirqd/210:46:192
1127957252,1sleep10-21swapper/110:02:421
1104055250,3sleep20-21swapper/209:48:292
1102906250,2sleep10-21swapper/109:45:471
1082881250,2sleep20-21swapper/209:35:182
1040059250,1sleep10-21swapper/109:10:091
1013955250,3sleep11014089-21timerandwakeup08:45:281
959453240,2sleep20-21swapper/208:05:182
1362024240,2sleep20-21swapper/212:30:152
1352067240,2sleep1214-21plymouthd12:21:331
1352067240,2sleep1214-21plymouthd12:21:321
1208736240,2sleep11208746-21ssh10:51:481
1038655240,2sleep21038827-21strings09:05:212
1023041240,2sleep20-21swapper/208:55:192
1014475240,2sleep20-21swapper/208:47:512
1002031240,2sleep2214-21plymouthd08:39:492
1027437230,1sleep20-21swapper/209:00:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional