You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 11:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Wed Mar 11, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9517429910790,1074cyclictest10926232sleep320:54:563
9517429910621,1056cyclictest1340785-21sleep23:40:003
951742992420,239cyclictest1416943-21turbostat00:34:553
13258972211,5sleep01326054-21ssh23:30:120
12912612210,1sleep00-21swapper/023:05:190
95174299187,7cyclictest1409377-21turbostat00:25:013
95174299185,8cyclictest11923002sleep322:00:173
95174299177,7cyclictest1354481-21taskset23:45:203
95174299176,7cyclictest1066221-21turbostat20:35:013
95174299175,9cyclictest1287350-21turbostat23:09:553
95174299171,12cyclictest1242183-21taskset22:35:113
951742991613,1cyclictest0-21swapper/300:35:313
951742991613,1cyclictest0-21swapper/300:35:303
95174299161,11cyclictest1234307-21turbostat22:30:003
95174299161,11cyclictest1120299-21turbostat21:15:013
95174299153,9cyclictest1371378-21taskset23:59:563
95174299151,11cyclictest1401796-21turbostat00:20:003
95174299151,11cyclictest1148816-21taskset21:30:193
95174299151,11cyclictest1057401-21taskset20:25:153
95174299151,10cyclictest1038841-21taskset20:10:223
95174299151,10cyclictest1038841-21taskset20:10:213
173198150,9rtkit-daemon1091734-21ntpq20:50:211
11337532151,5sleep21133799-21ntpq21:20:212
95174299144,7cyclictest1385612-21taskset00:06:243
95174299144,7cyclictest12115792sleep322:15:003
95174299141,9cyclictest9992582sleep319:40:213
95174299141,9cyclictest1315934-21taskset23:20:203
95174299141,9cyclictest11205722sleep321:15:133
95174299141,9cyclictest1028199-21chrt20:05:163
951742991412,0cyclictest0-21swapper/321:01:043
951742991412,0cyclictest0-21swapper/320:00:523
95174299141,11cyclictest1257044-21turbostat22:45:003
951742991411,1cyclictest0-21swapper/322:20:223
951742991411,1cyclictest0-21swapper/321:51:403
951742991411,1cyclictest0-21swapper/321:21:153
951742991411,1cyclictest0-21swapper/319:15:453
95174299141,10cyclictest967493-21taskset19:20:123
95174299141,10cyclictest952273-21taskset19:10:143
95174299141,10cyclictest1393286-21taskset00:11:383
95174299141,10cyclictest1276698-21taskset22:55:193
95174299141,10cyclictest1046213-21chrt20:17:513
95174299140,11cyclictest1264839-21taskset22:50:023
95174299140,11cyclictest1196625-21taskset22:05:023
95174299140,11cyclictest1158243-21turbostat21:40:003
95174299140,10cyclictest1325819-21taskset23:30:013
9505572140,9sleep2950601-21ntpq19:05:222
173198140,1rtkit-daemon0-21swapper/119:13:241
13697062140,6sleep01369831-21python323:55:240
9876182131,4sleep0988545-21irqrtprio19:35:170
95174299135,6cyclictest11357422sleep321:25:043
95174299134,7cyclictest993439-21taskset19:38:113
95174299131,9cyclictest1415107-21chrt00:25:203
95174299131,9cyclictest1377790-21taskset00:00:313
95174299131,9cyclictest13565022sleep323:50:103
95174299131,9cyclictest1286222-21taskset23:00:533
95174299131,9cyclictest1095628-21taskset20:55:163
95174299131,9cyclictest1085044-21taskset20:45:203
95174299131,8cyclictest1341358-21chrt23:40:123
95174299131,8cyclictest13028532sleep323:15:133
95174299131,8cyclictest12345822sleep322:30:113
951742991312,0cyclictest0-21swapper/319:26:003
951742991311,1cyclictest0-21swapper/320:20:093
95174299131,10cyclictest1072771-21taskset20:39:383
951742991310,1cyclictest0-21swapper/321:46:413
951742991310,1cyclictest0-21swapper/321:44:183
951742991310,1cyclictest0-21swapper/321:09:083
951742991310,1cyclictest0-21swapper/319:30:083
95174299130,9cyclictest12118692sleep322:15:123
95174299130,10cyclictest1007011-21chrt19:50:013
13743002130,10sleep11376348-21tr00:00:181
13489482131,2sleep10-21swapper/123:45:121
95174299124,6cyclictest13235132sleep323:25:213
95174299121,9cyclictest1301384-21taskset23:10:463
95174299121,9cyclictest1019788-21taskset19:57:313
95174299121,9cyclictest1006517-21taskset19:46:453
95174299120,9cyclictest1257278-21taskset22:45:023
95174299120,9cyclictest1182934-21taskset21:55:153
173198120,7rtkit-daemon1218061-21ssh22:16:100
173198120,2rtkit-daemon1112419-21diskmemload22:51:390
12937402120,4sleep11293744-21ssh23:05:361
95174299110,9cyclictest1079120-21taskset20:41:103
12947142111,2sleep20-21swapper/223:09:132
12248562112,5sleep21224901-21ntpq22:20:212
173198100,6rtkit-daemon1255818-21ssh22:40:311
173198100,6rtkit-daemon1120261-21ssh21:14:572
173198100,6rtkit-daemon0-21swapper/000:02:470
173198100,5rtkit-daemon1277909-21ntpq22:55:210
173198100,5rtkit-daemon1111479-21ntpq21:05:201
173198100,3rtkit-daemon643-21snmpd23:12:420
173198100,3rtkit-daemon643-21snmpd21:42:300
173198100,1rtkit-daemon0-21swapper/122:38:381
14316242101,7sleep11112419-21diskmemload00:37:171
14316242101,7sleep11112419-21diskmemload00:37:171
14247712100,6sleep01424783-21munin-plugin-st00:35:000
14107602100,7sleep21411892-21grep00:25:162
13313822101,5sleep11331434-21ntpq23:30:211
12476902100,7sleep01247742-21ntp_states22:35:220
12421432101,5sleep21242178-21apt-get22:35:122
12021212101,5sleep01202172-21ntpq22:05:190
11386252100,7sleep11140729-21grep21:25:171
11219662100,7sleep01123582-21cut21:15:190
10928812102,4sleep11092914-21apt-get20:55:111
10223352100,7sleep11024411-21grep20:00:181
979421292,4sleep1979461-21ntpq19:25:201
951463290,2sleep30-21swapper/319:09:553
17319890,6rtkit-daemon643-21snmpd19:06:531
17319890,5rtkit-daemon995269-21kthreadcore19:40:161
17319890,5rtkit-daemon1038824-21ntpq20:10:211
17319890,5rtkit-daemon1038824-21ntpq20:10:201
17319890,4rtkit-daemon1112419-21diskmemload00:28:230
17319890,3rtkit-daemon643-21snmpd22:43:570
17319890,2rtkit-daemon1181118-21ssh21:54:291
17319890,1rtkit-daemon0-21swapper/022:25:100
1341318291,4sleep21341353-21apt-get23:40:112
1285465290,5sleep11285517-21ntpq23:00:191
1202174291,4sleep11202210-21ssh22:05:201
1092627291,5sleep21092646-21munin-run20:55:002
992637281,4sleep1992686-21ntpq19:35:221
980388281,4sleep0980406-21munin-run19:30:000
952040281,3sleep0952073-21apt-get19:10:120
17319880,5rtkit-daemon643-21snmpd20:08:351
17319880,4rtkit-daemon453-21wpa_supplicant00:19:260
17319880,4rtkit-daemon453-21wpa_supplicant00:07:450
17319880,4rtkit-daemon435-21avahi-daemon19:32:241
17319880,4rtkit-daemon1333639-21df23:35:130
17319880,4rtkit-daemon1195634-21sh22:02:100
17319880,4rtkit-daemon1127496-21ssh21:18:262
17319880,4rtkit-daemon1073298-21cut20:40:141
17319880,3rtkit-daemon453-21wpa_supplicant19:15:111
17319880,3rtkit-daemon1112419-21diskmemload00:13:430
17319880,1rtkit-daemon0-21swapper/023:45:550
1369552280,5sleep11369593-21ssh23:55:211
1357434280,6sleep01358531-21kthreadcore23:50:150
1356167280,5sleep21356171-21ssh23:49:492
1343961280,5sleep01346033-21grep23:40:170
1318015281,3sleep11318054-21ssh23:25:111
1311449281,4sleep21312564-21grep23:20:162
1310436281,3sleep11310473-21apt-get23:20:111
1309328280,1sleep20-21swapper/223:17:002
1308326281,4sleep01308379-21ntpq23:15:210
1305935281,4sleep11308020-21cut23:15:191
1287299281,4sleep01287303-21ssh23:04:550
1264884282,3sleep11264917-21apt-get22:50:141
1256978284,1sleep20-21swapper/222:44:492
1233591280,5sleep11233595-21ssh22:27:241
1219391281,3sleep11219426-21apt-get22:20:121
1186374280,5sleep11186888-21/usr/sbin/munin21:55:191
1114481281,5sleep01116411-21kthreadcore21:10:170
1099683280,5sleep11099775-21fschecks_time21:00:131
1093134281,4sleep01093260-21/usr/sbin/munin20:55:140
1059907281,4sleep01060062-21diskstats20:30:140
1046694281,4sleep11046846-21df_inode20:20:141
1045337281,4sleep11045432-21ntpq20:15:201
1007060281,4sleep21007215-21diskstats19:50:132
1000487281,4sleep21000643-21diskstats19:45:122
976071270,4sleep2978116-21kthreadcore19:25:172
945509271,3sleep0945816-21irqcore19:05:170
17319870,4rtkit-daemon958648-21munin-node21:45:370
17319870,4rtkit-daemon649-21ntpd20:31:121
17319870,4rtkit-daemon647-21lldpd21:49:321
17319870,3rtkit-daemon972858-21ntpq19:20:201
17319870,3rtkit-daemon958648-21munin-node22:00:201
17319870,3rtkit-daemon958648-21munin-node21:30:291
17319870,3rtkit-daemon649-21ntpd19:45:131
17319870,3rtkit-daemon649-21ntpd00:35:200
17319870,3rtkit-daemon649-21ntpd00:35:190
17319870,3rtkit-daemon643-21snmpd21:35:560
17319870,3rtkit-daemon643-21snmpd20:48:401
17319870,3rtkit-daemon1128601-21ssh21:20:131
17319870,3rtkit-daemon1009870-21kthreadcore19:50:171
17319870,2rtkit-daemon0-21swapper/000:20:210
1404646270,4sleep11406754-21grep00:20:181
1401491270,1sleep20-21swapper/200:18:552
1399920271,3sleep11399982-21ntpq00:15:211
1379575270,4sleep21379846-21sed00:05:162
1379448270,4sleep11379574-21hddtemp_smartct00:05:151
1324107270,1sleep00-21swapper/023:25:350
1300684270,4sleep11300737-21ntpq23:10:211
1286772271,2sleep20-21swapper/223:02:532
1274667270,4sleep21276697-21tr22:55:192
1257353270,4sleep01257500-21df22:45:110
1234612271,3sleep01234769-21/usr/sbin/munin22:30:120
1203960270,4sleep01204206-21date22:10:010
1158534271,3sleep11158569-21apt-get21:40:131
1157807270,2sleep11157811-21ssh21:38:231
1143561270,4sleep01143612-21fschecks_count21:30:140
1143372271,3sleep21143411-21ssh21:30:112
1142933270,5sleep21142937-21ssh21:29:232
1141273270,4sleep01141327-21ntpq21:25:200
1129033271,3sleep01129899-21cut21:20:150
1123583271,2sleep10-21swapper/121:15:201
1075152270,5sleep21077231-21kthreadcore20:40:182
1071696270,4sleep11071846-21ntpq20:35:201
1053269271,3sleep01053302-21apt-get20:25:090
1052268270,5sleep01052390-21switchtime20:20:250
1052136270,4sleep21052178-21ntpq20:20:232
1033638271,3sleep01033764-21hddtemp_smartct20:10:160
1033638271,3sleep01033764-21hddtemp_smartct20:10:150
1032130271,3sleep21032235-21ntpq20:05:202
1029344271,3sleep01031478-21kthreadcore20:05:180
1019040271,3sleep01019084-21ntpq19:55:200
999155261,2sleep20-21swapper/219:40:202
982023261,2sleep0221rcuc/019:30:170
967820261,2sleep20-21swapper/219:20:162
958653260,3sleep0960160-21cut19:15:020
17319860,3rtkit-daemon649-21ntpd22:20:140
17319860,3rtkit-daemon643-21snmpd20:27:201
17319860,2rtkit-daemon34-21ksoftirqd/119:57:081
17319860,2rtkit-daemon1210456-21ssh22:10:491
1410017260,3sleep11410759-21sed00:25:161
1408150260,1sleep20-21swapper/200:20:272
1393283260,3sleep21112419-21diskmemload00:11:382
1324393260,3sleep21324397-21ssh23:26:372
1263905260,1sleep21263909-21ssh22:47:252
1259786261,2sleep10-21swapper/122:45:161
1240847260,1sleep21240851-21ssh22:31:142
1234140260,1sleep20-21swapper/222:29:302
1217968260,3sleep11217970-21ssh22:15:501
1212125262,1sleep2431ktimers/222:15:152
1204569260,3sleep21204676-21ps22:10:142
1178555260,3sleep21179322-21missed_timers21:50:182
1166663260,3sleep21167101-21sed21:45:132
1159660260,3sleep21160823-21cut21:40:182
1112727260,3sleep11112420-21apt-get21:10:021
1085097260,3sleep01085148-21ntp_states20:45:210
1055332260,4sleep21057400-21kthreadcore20:25:152
989703251,2sleep20-21swapper/219:35:192
969793250,2sleep00-21swapper/019:20:180
960844250,2sleep20-21swapper/219:15:122
952220250,3sleep2952269-21grep19:10:142
1426469251,2sleep20-21swapper/200:35:192
1426469251,2sleep20-21swapper/200:35:182
1423570250,3sleep10-21swapper/100:30:281
1419628250,2sleep21421630-21kthreadcore00:30:172
1388549251,2sleep10-21swapper/100:10:171
1378649250,3sleep20-21swapper/200:03:482
1366892250,2sleep21368972-21grep23:55:192
1356461250,3sleep21356465-21ssh23:50:012
1356218250,3sleep11324544-21kworker/u16:4+nfsiod23:50:001
1347990250,3sleep11347994-21ssh23:42:351
1340422250,2sleep20-21swapper/223:38:432
1334879251,2sleep10-21swapper/123:35:171
1332679250,2sleep21112419-21diskmemload23:33:112
1295390250,2sleep21295503-21ssh23:10:142
1272441250,2sleep11112419-21diskmemload22:55:101
1271832250,2sleep21271836-21ssh22:53:422
1240103250,2sleep11240141-21ssh22:30:211
1202779251,2sleep21165645-21kworker/u16:3+rpciod22:05:302
1195478250,3sleep20-21swapper/222:01:372
1187947250,3sleep00-21swapper/021:56:430
1181544251,1sleep20-21swapper/221:55:112
1180560250,2sleep01112419-21diskmemload21:52:210
1150941250,2sleep21150975-21ssh21:35:122
1106902250,3sleep01107831-21tr21:05:160
1100874250,2sleep00-21swapper/021:00:160
1099782250,2sleep21099880-21/usr/sbin/munin21:00:142
1099144250,1sleep20-21swapper/220:59:012
1087646250,2sleep00-21swapper/020:50:170
1079669250,2sleep20-21swapper/220:45:122
1073077250,2sleep00-21swapper/020:40:120
1060181250,2sleep21060392-21cut20:30:172
1046130250,1sleep00-21swapper/020:16:480
1041391251,2sleep20-21swapper/220:15:172
1034309251,2sleep20-21swapper/220:10:182
1034309251,2sleep20-21swapper/220:10:172
1025736250,3sleep20-21swapper/220:00:232
1013362251,2sleep00-21swapper/019:55:000
1000188250,3sleep00-21swapper/019:44:540
986884240,2sleep2643-21snmpd19:33:432
1314566240,1sleep00-21swapper/023:20:180
1112286240,3sleep20-21swapper/221:08:262
1072659240,3sleep00-21swapper/020:38:120
1067380240,2sleep20-21swapper/220:35:172
1021177240,2sleep00-21swapper/020:00:180
1013920230,1sleep20-21swapper/219:55:152
1000450230,1sleep00-21swapper/019:45:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional