You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 11:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Mon Dec 01, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
129291421030,3sleep2421rcuc/223:59:592
865356992421,1cyclictest0-21swapper/323:20:013
865356992219,1cyclictest0-21swapper/323:20:233
865356992017,1cyclictest0-21swapper/323:00:013
865356992017,1cyclictest0-21swapper/319:45:003
865356992017,1cyclictest0-21swapper/300:30:263
86535699201,14cyclictest1155873-21taskset22:35:003
86535699201,14cyclictest1083057-21taskset21:50:003
86535699198,7cyclictest10667182sleep321:39:263
865356991916,1cyclictest0-21swapper/322:45:193
865356991916,1cyclictest0-21swapper/321:25:023
865356991916,1cyclictest0-21swapper/320:04:593
86535699191,14cyclictest1196267-21taskset23:00:133
86535699191,13cyclictest905029-21chrt19:39:563
86535699191,13cyclictest1018305-21turbostat21:10:013
865356991815,1cyclictest0-21swapper/320:55:003
865356991815,1cyclictest0-21swapper/319:20:203
865356991814,1cyclictest0-21swapper/300:10:003
865356991812,3cyclictest0-21swapper/320:00:003
86535699181,13cyclictest922820-21taskset19:50:223
86535699181,13cyclictest1019518-21taskset21:10:163
86535699181,12cyclictest968123-21taskset20:30:013
86535699181,12cyclictest968123-21taskset20:30:013
86535699176,7cyclictest1319306-21taskset00:19:443
865356991714,1cyclictest0-21swapper/322:10:133
865356991714,1cyclictest0-21swapper/321:50:183
865356991714,1cyclictest0-21swapper/320:25:203
865356991714,1cyclictest0-21swapper/319:45:153
865356991714,1cyclictest0-21swapper/300:00:003
865356991713,1cyclictest0-21swapper/320:55:183
86535699171,13cyclictest955620-21taskset20:20:033
86535699171,13cyclictest879873-21chrt19:18:553
86535699171,13cyclictest1327742-21taskset00:25:053
86535699171,12cyclictest992333-21taskset20:45:243
86535699171,12cyclictest980890-21taskset20:40:153
86535699171,12cyclictest980097-21taskset20:35:503
86535699171,12cyclictest898765-21chrt19:34:553
86535699171,12cyclictest1351261-21taskset00:38:323
86535699171,12cyclictest1283352-21taskset23:51:473
86535699171,12cyclictest1250449-21taskset23:30:233
86535699171,12cyclictest1164174-21taskset22:40:133
86535699171,12cyclictest1124079-21taskset22:15:173
86535699171,11cyclictest1260968-21chrt23:40:133
86535699171,11cyclictest1059158-21taskset21:35:013
86535699164,9cyclictest1212034-21sleep23:10:003
865356991613,1cyclictest0-21swapper/323:45:243
865356991613,1cyclictest0-21swapper/322:50:213
865356991613,1cyclictest0-21swapper/320:15:193
865356991613,1cyclictest0-21swapper/300:00:213
865356991612,1cyclictest0-21swapper/321:15:143
86535699161,12cyclictest943559-21chrt20:10:173
86535699161,12cyclictest938693-21taskset20:05:173
86535699161,12cyclictest1240342-21taskset23:25:173
86535699161,12cyclictest1219930-21taskset23:14:523
86535699161,12cyclictest1145886-21chrt22:25:353
86535699161,12cyclictest1114318-21taskset22:07:233
86535699161,12cyclictest1106401-21chrt22:02:463
86535699161,12cyclictest1071203-21taskset21:40:183
86535699161,11cyclictest865557-21chrt19:10:143
86535699160,13cyclictest1139246-21chrt22:24:223
86535699160,12cyclictest892365-21chrt19:28:143
86535699160,12cyclictest1010576-21chrt21:00:193
147598160,3rtkit-daemon0-21swapper/100:30:251
86535699151,11cyclictest1309298-21taskset00:10:223
86535699151,11cyclictest1252899-21chrt23:35:123
86535699151,11cyclictest1156111-21taskset22:35:083
86535699151,11cyclictest1097414-21taskset21:55:373
86535699151,11cyclictest1034797-21chrt21:20:023
86535699150,12cyclictest1319732-21chrt00:20:073
147598140,8rtkit-daemon476-21wpa_supplicant21:20:112
10493812141,9sleep11049387-21ssh21:26:271
9775742130,6sleep1979352-21latency20:35:211
13497872131,9sleep21349928-21sh00:35:272
11806672131,3sleep11181388-21irqrtprio22:50:181
9220642120,9sleep2917820-21/usr/sbin/munin19:50:222
13443542121,8sleep01344454-21fschecks_time00:35:160
13187232128,2sleep21018304-21diskmemload00:18:242
13032462120,8sleep01303260-21latency_hist00:10:000
12518522121,8sleep01251860-21ssh23:33:210
12277922120,8sleep11227800-21ssh23:19:241
8683262110,9sleep00-21swapper/019:10:200
8593242111,4sleep20-21swapper/219:05:122
147598110,7rtkit-daemon1540-21sendmail-mta21:24:500
147598110,7rtkit-daemon1180747-21irqcore22:50:180
12704472110,8sleep21271629-21cut23:45:182
12426662110,4sleep11242674-21ssh23:25:291
12286252110,7sleep11228668-21apt-get23:20:121
11289582110,1sleep01129043-21ntp_states22:15:230
10819842111,7sleep21081990-21ssh21:47:442
10324572110,8sleep01032465-21ssh21:15:440
9178562100,3sleep0917989-21tr19:50:160
8855522100,7sleep0885730-21timerwakeupswit19:20:260
147598100,6rtkit-daemon730-21ntpd21:29:080
147598100,2rtkit-daemon214-21plymouthd22:06:161
147598100,2rtkit-daemon1034190-21ssh21:19:432
12087612100,7sleep11209376-21missed_timers23:05:201
11532652100,7sleep01153348-21ntpq22:30:220
10917552100,7sleep21091796-21fschecks_count21:55:172
995577290,6sleep1996978-21kthreadcore20:50:201
982102290,6sleep2983692-21kthreadcore20:40:192
980701291,4sleep1980734-21apt-get20:40:141
871264290,1sleep10-21swapper/119:11:181
14759890,5rtkit-daemon729-21lldpd22:18:161
14759890,5rtkit-daemon720-21snmpd21:33:430
14759890,5rtkit-daemon313-21systemd-udevd20:27:422
14759890,5rtkit-daemon214-21plymouthd22:39:170
14759890,5rtkit-daemon1123262-21ssh22:14:341
14759890,4rtkit-daemon1164549-21hddtemp_smartct22:40:160
14759890,4rtkit-daemon1147137-21ssh22:28:331
14759890,1rtkit-daemon0-21swapper/123:45:451
14759890,1rtkit-daemon0-21swapper/123:03:401
1341077290,6sleep01341155-21sendmail_mailqu00:30:240
1260596291,5sleep21260627-21munin-run23:40:012
1209377290,6sleep21209529-21ntpq23:05:222
1149543290,6sleep11151220-21kthreadcore22:30:191
1137150290,6sleep21018304-21diskmemload22:20:212
1090901290,3sleep11090909-21ssh21:54:121
1089303290,6sleep21089311-21ssh21:50:282
1026195291,1sleep00-21swapper/021:14:550
955633281,4sleep1955666-21apt-get20:20:141
949374281,4sleep1949406-21apt-get20:15:131
911555281,4sleep1911588-21apt-get19:45:121
865521281,3sleep2865554-21apt-get19:10:142
14759880,4rtkit-daemon871730-21munin-node22:01:240
14759880,4rtkit-daemon730-21ntpd19:58:302
14759880,4rtkit-daemon720-21snmpd21:10:342
14759880,4rtkit-daemon476-21wpa_supplicant21:46:030
14759880,4rtkit-daemon476-21wpa_supplicant20:31:492
14759880,4rtkit-daemon476-21wpa_supplicant20:31:492
14759880,4rtkit-daemon295-21systemd-journal00:23:341
14759880,4rtkit-daemon22110-21packagekitd20:05:332
14759880,4rtkit-daemon214-21plymouthd22:20:461
14759880,4rtkit-daemon1308790-21ntp_states00:10:152
14759880,4rtkit-daemon1-21systemd23:52:360
14759880,4rtkit-daemon1-21systemd00:06:132
14759880,4rtkit-daemon1-21systemd00:03:072
14759880,4rtkit-daemon1094621-21kthreadcore21:55:200
14759880,3rtkit-daemon899064-21apt-get19:35:132
14759880,3rtkit-daemon214-21plymouthd22:02:512
14759880,3rtkit-daemon214-21plymouthd19:09:150
14759880,3rtkit-daemon1252051-21ssh23:33:451
14759880,1rtkit-daemon0-21swapper/220:55:082
14759880,1rtkit-daemon0-21swapper/220:52:512
14759880,1rtkit-daemon0-21swapper/200:31:052
14759880,1rtkit-daemon0-21swapper/019:19:260
1329223280,5sleep21330575-21kthreadcore00:25:172
1282828280,1sleep20-21swapper/223:50:312
1244496280,1sleep00-21swapper/023:29:450
1188554280,5sleep20-21swapper/222:55:162
1169935281,4sleep21169943-21ssh22:40:292
1098895280,2sleep10-21swapper/121:59:051
1083619281,4sleep01083774-21diskstats21:50:140
1013660280,5sleep21015184-21kthreadcore21:05:202
993240270,4sleep0993383-21df20:50:150
969978271,3sleep0971983-21cut20:30:190
969978271,3sleep0971983-21cut20:30:190
966982270,4sleep0967041-21ntp_states20:25:220
897887271,3sleep20-21swapper/219:30:222
885946270,1sleep20-21swapper/219:21:162
8653569975,1cyclictest0-21swapper/319:10:013
14759870,4rtkit-daemon871730-21munin-node20:16:122
14759870,4rtkit-daemon871730-21munin-node00:26:271
14759870,4rtkit-daemon214-21plymouthd20:22:442
14759870,4rtkit-daemon1-21systemd23:12:002
14759870,3rtkit-daemon871730-21munin-node22:35:131
14759870,3rtkit-daemon730-21ntpd23:35:051
14759870,3rtkit-daemon720-21snmpd23:42:221
14759870,3rtkit-daemon313-21systemd-udevd19:45:422
14759870,3rtkit-daemon214-21plymouthd20:45:302
14759870,3rtkit-daemon214-21plymouthd20:35:062
14759870,3rtkit-daemon214-21plymouthd20:10:162
14759870,3rtkit-daemon214-21plymouthd19:41:402
14759870,3rtkit-daemon214-21plymouthd19:25:130
14759870,3rtkit-daemon1-21systemd22:55:290
14759870,3rtkit-daemon1-21systemd22:45:470
14759870,3rtkit-daemon1-21systemd21:04:372
14759870,3rtkit-daemon1-21systemd20:00:322
14759870,3rtkit-daemon1-21systemd00:19:411
14759870,3rtkit-daemon1195932-21kworker/u16:3+nfsiod23:10:251
14759870,2rtkit-daemon214-21plymouthd21:35:120
1351423270,1sleep10-21swapper/100:39:031
1266947270,2sleep20-21swapper/223:40:572
1212273271,3sleep01212308-21apt-get23:10:130
1188214270,5sleep11018304-21diskmemload22:55:111
1164063270,1sleep10-21swapper/122:40:041
1141531270,4sleep21142753-21tr22:25:192
1073660270,1sleep00-21swapper/021:41:520
1059293270,4sleep21059330-21apt-get21:35:132
1043392270,5sleep21043554-21gltestperf21:25:142
1024514271,4sleep11024520-21ssh21:10:441
992934260,1sleep00-21swapper/020:49:510
986691260,1sleep00-21swapper/020:44:500
973787260,1sleep10-21swapper/120:30:281
973787260,1sleep10-21swapper/120:30:281
963308260,3sleep1965150-21grep20:25:181
961464260,1sleep00-21swapper/020:23:060
948966260,1sleep10-21swapper/120:13:091
937291261,2sleep10-21swapper/120:05:151
935520260,4sleep0935567-21grep20:00:220
932855260,4sleep10-21swapper/120:00:191
929979260,1sleep00-21swapper/019:58:370
916908261,3sleep0917162-21head19:45:230
910967260,1sleep10-21swapper/119:40:471
892763260,3sleep1892796-21apt-get19:30:131
892500260,1sleep10-21swapper/119:29:571
880678261,2sleep10-21swapper/119:20:191
872219261,3sleep21-21systemd19:15:032
871812260,3sleep1872218-21irqstats19:15:021
14759860,2rtkit-daemon214-21plymouthd19:26:052
1327214260,1sleep20-21swapper/200:24:292
1325648260,1sleep00-21swapper/000:20:460
1311629260,3sleep01311778-21df00:15:090
1310248260,1sleep10-21swapper/100:12:341
1308738260,3sleep01308796-21ntp_states00:10:160
1299904260,4sleep11299912-21ssh00:02:401
1294698261,3sleep01296606-21ssh00:00:190
1292884260,1sleep00-21swapper/023:59:580
1292219260,1sleep10-21swapper/123:58:271
1276097260,1sleep00-21swapper/023:48:280
1258805260,1sleep00-21swapper/023:35:500
1251964260,1sleep20-21swapper/223:33:352
1236500260,3sleep21236830-21ssh23:25:022
1235362260,1sleep20-21swapper/223:22:412
1221762260,4sleep01222885-21grep23:15:180
1201524260,3sleep01201657-21python323:00:230
1187021260,1sleep20-21swapper/222:53:002
1178386260,1sleep20-21swapper/222:46:232
1162306260,1sleep20-21swapper/222:36:292
1136985260,3sleep01137070-21ntp_states22:20:200
1115706260,3sleep21115743-21apt-get22:10:122
1115126260,1sleep00-21swapper/022:09:180
1114824261,2sleep20-21swapper/222:08:402
1076772260,3sleep11078302-21tr21:45:181
1059565261,2sleep10-21swapper/121:35:161
1057605260,1sleep20-21swapper/221:31:532
1041096260,1sleep10-21swapper/121:21:301
1033432260,1sleep10-21swapper/121:17:561
1012260261,2sleep10-21swapper/121:05:151
1011776260,3sleep01011761-21apt-get21:05:010
1005765260,3sleep11005914-21df_inode21:00:141
1005730260,2sleep00-21swapper/021:00:130
1001396261,3sleep01003399-21kthreadcore20:55:200
986957250,3sleep10-21swapper/120:45:071
948779250,3sleep00-21swapper/020:10:440
942839250,1sleep00-21swapper/020:09:150
929777250,3sleep10-21swapper/119:56:021
923491250,3sleep10-21swapper/119:50:451
910394250,3sleep0910458-21ntp_states19:40:220
899031250,2sleep00-21swapper/019:35:130
898719250,1sleep00-21swapper/019:34:200
1334235250,3sleep00-21swapper/000:27:000
1277045250,2sleep10-21swapper/123:50:141
1267088250,3sleep00-21swapper/023:41:150
1226242251,2sleep21226248-21ssh23:15:392
1206741251,2sleep01208758-21kthreadcore23:05:200
1196229250,2sleep20-21swapper/223:00:132
1172214250,2sleep10-21swapper/122:45:131
1129748250,3sleep20-21swapper/222:15:532
1118195250,2sleep00-21swapper/022:10:180
1099623251,2sleep11099660-21apt-get22:00:131
1067337250,3sleep11067395-21grep21:40:131
975818240,2sleep00-21swapper/020:35:200
955148240,3sleep00-21swapper/020:17:240
859660240,1sleep10-21swapper/119:05:161
1301732240,2sleep11301740-21ssh00:06:331
1148054240,2sleep20-21swapper/222:30:082
1069228240,2sleep20-21swapper/221:40:182
1053138240,2sleep11055080-21kthreadcore21:30:191
999647230,1sleep10-21swapper/120:55:171
899022230,1sleep10-21swapper/119:35:061
1228597230,1sleep00-21swapper/023:20:030
1140071230,1sleep00-21swapper/022:25:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional