You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-28 - 05:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Sun Dec 28, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9345239912720,1268cyclictest11748602sleep322:15:013
9345239912330,1229cyclictest13492592sleep300:29:563
9345239912223,1214cyclictest1245531-21sleep23:10:003
13033162340,1sleep10-21swapper/123:54:591
934523992118,1cyclictest0-21swapper/322:45:163
934523991916,1cyclictest0-21swapper/319:20:003
934523991714,1cyclictest0-21swapper/319:25:203
93452399164,9cyclictest1110212-21turbostat21:24:593
934523991613,1cyclictest0-21swapper/323:50:143
934523991613,1cyclictest0-21swapper/323:30:153
934523991613,1cyclictest0-21swapper/319:20:173
93452399161,11cyclictest1226462-21taskset22:55:113
93452399160,12cyclictest994654-21turbostat19:55:013
93452399159,3cyclictest1103793-21sleep21:20:003
93452399156,7cyclictest1148983-21turbostat21:59:553
934523991513,1cyclictest0-21swapper/321:35:123
934523991513,1cyclictest0-21swapper/319:35:143
934523991512,1cyclictest0-21swapper/323:40:223
934523991512,1cyclictest0-21swapper/323:14:003
934523991512,1cyclictest0-21swapper/320:40:153
934523991512,1cyclictest0-21swapper/320:10:263
934523991512,1cyclictest0-21swapper/319:56:283
93452399151,11cyclictest1084146-21taskset21:00:253
93452399151,11cyclictest1071707-21taskset20:55:003
93452399151,10cyclictest1052392-21turbostat20:40:013
93452399151,10cyclictest1020572-21taskset20:15:123
934523991413,0cyclictest0-21swapper/323:22:143
934523991412,1cyclictest0-21swapper/323:38:343
934523991412,1cyclictest0-21swapper/323:19:253
934523991412,1cyclictest0-21swapper/322:51:403
934523991412,1cyclictest0-21swapper/319:47:523
934523991412,1cyclictest0-21swapper/300:21:373
934523991412,0cyclictest0-21swapper/322:42:013
934523991412,0cyclictest0-21swapper/319:42:523
93452399141,10cyclictest968151-21taskset19:30:223
93452399141,10cyclictest968151-21taskset19:30:223
93452399141,10cyclictest1350500-21taskset00:30:163
93452399141,10cyclictest1330268-21taskset00:15:023
93452399141,10cyclictest1316611-21turbostat00:04:593
93452399141,10cyclictest1232875-21taskset23:00:013
93452399141,10cyclictest1200296-21turbostat22:35:013
93452399141,10cyclictest1142500-21chrt21:49:373
93452399141,10cyclictest1033425-21taskset20:25:153
93452399141,10cyclictest1013834-21taskset20:09:523
93452399140,11cyclictest1117117-21chrt21:30:023
11812692140,1sleep30-21swapper/322:20:153
93452399137,4cyclictest1355699-21turbostat00:39:543
93452399131,9cyclictest1077913-21taskset20:57:443
93452399131,9cyclictest1007139-21taskset20:00:593
93452399131,8cyclictest11427862sleep321:50:143
934523991312,0cyclictest0-21swapper/321:05:123
934523991312,0cyclictest0-21swapper/320:47:113
934523991311,1cyclictest0-21swapper/323:45:473
934523991311,1cyclictest0-21swapper/323:25:083
934523991311,1cyclictest0-21swapper/322:25:443
934523991311,1cyclictest0-21swapper/319:10:173
93452399131,10cyclictest1309864-21turbostat00:00:003
934523991311,0cyclictest0-21swapper/322:11:313
934523991310,1cyclictest0-21swapper/321:11:353
93452399130,10cyclictest1322883-21chrt00:08:253
93452399130,10cyclictest1322883-21chrt00:08:253
93452399130,10cyclictest1162444-21taskset22:05:163
93452399130,10cyclictest1026962-21taskset20:20:023
93452399121,9cyclictest1161509-21taskset22:01:223
934523991211,0cyclictest0-21swapper/321:40:283
934523991211,0cyclictest0-21swapper/300:10:023
934523991210,1cyclictest0-21swapper/320:32:523
93452399120,9cyclictest1200791-21taskset22:35:093
93452399120,9cyclictest1116586-21taskset21:26:213
9438432111,8sleep1943290-21/usr/sbin/munin19:15:171
301798110,5rtkit-daemon1007899-21df_inode20:05:172
301798110,4rtkit-daemon941021-21munin-node22:40:350
301798110,4rtkit-daemon941021-21munin-node00:21:450
13090062111,3sleep21309056-21/usr/sbin/munin23:55:232
9287172101,6sleep0929090-21cut19:05:200
301798100,6rtkit-daemon317-21systemd-udevd21:53:322
301798100,6rtkit-daemon1057566-21tr20:40:192
301798100,5rtkit-daemon1039807-21awk20:30:142
301798100,3rtkit-daemon430-21avahi-daemon00:08:280
301798100,3rtkit-daemon430-21avahi-daemon00:08:270
12910702104,4sleep01291987-21irqrtprio23:45:190
12831182101,5sleep11283242-21python323:35:221
12002782100,6sleep21200429-21grep22:35:002
11831142100,7sleep11185169-21grep22:20:211
10269742100,6sleep01027007-21apt-get20:20:120
30179890,5rtkit-daemon981828-21cron19:45:002
30179890,5rtkit-daemon939791-21sed19:10:210
30179890,5rtkit-daemon447-21systemd-logind22:51:330
30179890,5rtkit-daemon317-21systemd-udevd23:19:330
30179890,4rtkit-daemon950045-21apt-get19:20:140
30179890,4rtkit-daemon638-21ntpd19:50:562
30179890,4rtkit-daemon1329442-21lsb_release00:11:090
30179890,2rtkit-daemon3205-21sendmail-mta23:06:380
30179890,1rtkit-daemon0-21swapper/023:59:450
30179890,1rtkit-daemon0-21swapper/023:42:540
30179890,1rtkit-daemon0-21swapper/022:29:320
30179890,1rtkit-daemon0-21swapper/019:30:140
30179890,1rtkit-daemon0-21swapper/019:30:130
1276675290,2sleep21276750-21ps23:30:222
1266686292,5sleep11268709-21kthreadcore23:25:201
1232887291,4sleep01232920-21apt-get23:00:110
1084777291,5sleep11084799-21apt-get21:05:131
1072392291,5sleep01073383-21irqstats20:55:180
962820281,4sleep1962853-21apt-get19:30:131
962820281,4sleep1962853-21apt-get19:30:121
957882280,6sleep2959512-21cat19:25:172
30179880,5rtkit-daemon636-21snmpd23:21:570
30179880,5rtkit-daemon3205-21sendmail-mta23:50:330
30179880,5rtkit-daemon3205-21sendmail-mta23:37:330
30179880,5rtkit-daemon3205-21sendmail-mta23:28:570
30179880,5rtkit-daemon3205-21sendmail-mta00:19:080
30179880,4rtkit-daemon941021-21munin-node22:30:450
30179880,4rtkit-daemon941021-21munin-node22:20:470
30179880,4rtkit-daemon941021-21munin-node21:47:532
30179880,4rtkit-daemon941021-21munin-node19:56:022
30179880,4rtkit-daemon941021-21munin-node00:35:022
30179880,4rtkit-daemon667-21lldpd00:31:102
30179880,4rtkit-daemon636-21snmpd22:35:280
30179880,4rtkit-daemon636-21snmpd22:06:152
30179880,4rtkit-daemon636-21snmpd21:31:252
30179880,4rtkit-daemon636-21snmpd21:00:202
30179880,4rtkit-daemon636-21snmpd20:37:402
30179880,4rtkit-daemon636-21snmpd20:17:232
30179880,4rtkit-daemon636-21snmpd00:02:450
30179880,4rtkit-daemon492-21gmain19:49:282
30179880,4rtkit-daemon448-21wpa_supplicant21:20:142
30179880,4rtkit-daemon448-21wpa_supplicant21:15:142
30179880,4rtkit-daemon448-21wpa_supplicant19:25:580
30179880,4rtkit-daemon317-21systemd-udevd20:01:332
30179880,4rtkit-daemon1272706-21cut23:30:170
30179880,4rtkit-daemon1068551-21cut20:50:182
30179880,4rtkit-daemon0-21swapper/220:10:162
30179880,1rtkit-daemon0-21swapper/022:49:370
1349263281,4sleep21349273-21ls00:29:592
1330474280,5sleep21330675-21hddtemp_smartct00:15:142
1311879281,4sleep11313618-21cut00:00:181
1268713280,5sleep21270070-21memory23:25:212
1207210280,2sleep11207243-21apt-get22:40:131
1091354281,4sleep21091554-21hddtemp_smartct21:10:142
1052642281,4sleep11052675-21apt-get20:40:131
1002779280,1sleep01004274-21kthreadcore20:00:210
969234271,3sleep0969267-21apt-get19:35:130
934362270,2sleep30-21swapper/319:09:553
30179870,4rtkit-daemon941021-21munin-node22:01:282
30179870,3rtkit-daemon941021-21munin-node21:41:452
30179870,3rtkit-daemon941021-21munin-node20:46:452
30179870,3rtkit-daemon941021-21munin-node19:15:150
30179870,3rtkit-daemon941021-21munin-node00:24:152
30179870,3rtkit-daemon638-21ntpd20:26:522
30179870,3rtkit-daemon636-21snmpd22:56:360
30179870,3rtkit-daemon636-21snmpd21:36:342
30179870,3rtkit-daemon636-21snmpd20:20:052
30179870,3rtkit-daemon430-21avahi-daemon23:10:230
30179870,3rtkit-daemon430-21avahi-daemon19:38:522
30179870,3rtkit-daemon1168666-21df22:10:142
30179870,3rtkit-daemon1154684-21sh21:55:242
1356328270,4sleep11356671-21irqcore00:35:161
1343166270,4sleep01343214-21cpu00:25:140
1174872270,3sleep01174905-21apt-get22:15:120
1149616270,5sleep11149833-21irqcore21:55:171
1138910271,3sleep10-21swapper/121:45:201
1123718270,4sleep01123877-21grep21:35:170
1111154270,4sleep21111897-21irqrtprio21:25:172
1104040270,3sleep11104073-21apt-get21:20:151
1102988270,1sleep10-21swapper/121:15:221
1039977270,4sleep00-21swapper/020:30:180
1027450271,3sleep11028434-21kernelversion20:20:171
1009943271,4sleep00-21swapper/020:05:210
982578261,2sleep10-21swapper/119:45:191
955991260,1sleep20-21swapper/219:22:402
943326260,3sleep2943482-21diskstats19:15:142
929972261,2sleep20-21swapper/219:05:222
30179860,2rtkit-daemon1090474-21awk21:05:242
1329151260,4sleep11329173-21apt-get00:11:081
1319697261,2sleep20-21swapper/200:05:202
1319697261,2sleep20-21swapper/200:05:202
1316885261,3sleep11317037-21df_inode00:05:151
1316885261,3sleep11317037-21df_inode00:05:141
1316552260,3sleep21316553-21sshd00:04:322
1304192260,4sleep11305185-21cut23:55:171
1295937261,3sleep21296041-21sendmail_mailtr23:45:252
1259558261,2sleep20-21swapper/223:20:172
1252335260,3sleep21252535-21hddtemp_smartct23:15:162
1245490260,1sleep1171rcu_preempt23:09:501
1232299260,1sleep20-21swapper/222:56:032
1174653260,1sleep20-21swapper/222:15:012
1168713261,2sleep10-21swapper/122:10:161
1167334260,3sleep01167390-21ntp_states22:05:210
1160899260,3sleep01160957-21ntp_states22:00:250
1143768260,4sleep01144629-21cut21:50:190
1136336260,1sleep00-21swapper/021:45:020
1123523261,2sleep11123556-21apt-get21:35:141
1116016260,1sleep00-21swapper/021:25:220
1109515260,4sleep01109736-21unixbench_multi21:20:260
1099307261,2sleep00-21swapper/021:15:170
1097137260,1sleep00-21swapper/021:12:410
1090629260,1sleep00-21swapper/021:06:320
1078551260,4sleep01078623-21fschecks_time21:00:150
1078065260,1sleep10-21swapper/120:59:441
1072121260,1sleep20-21swapper/220:55:152
1058461261,3sleep0636-21snmpd20:40:400
1047639260,4sleep01049125-21kthreadcore20:35:190
1026698260,3sleep11026878-21sed20:20:011
1015092260,4sleep01016133-21grep20:10:190
981640250,1sleep10-21swapper/119:42:391
975671250,2sleep0975703-21apt19:40:130
969270250,3sleep1969419-21df_inode19:35:141
951571252,1sleep1321rcuc/119:20:191
940663250,1sleep20-21swapper/219:12:272
933477250,1sleep10-21swapper/119:05:251
1361831250,1sleep00-21swapper/000:36:230
1351536250,2sleep00-21swapper/000:30:180
1344634251,2sleep10-21swapper/100:25:181
1342544250,1sleep10-21swapper/100:20:421
1336086250,1sleep10-21swapper/100:15:291
1296762250,2sleep10-21swapper/123:50:011
1290364250,1sleep10-21swapper/123:44:561
1284608251,2sleep20-21swapper/223:40:162
1277419250,1sleep10-21swapper/123:33:421
1258577250,2sleep10-21swapper/123:20:121
1253828250,2sleep10-21swapper/123:15:191
1251784250,1sleep20-21swapper/223:13:422
1245481250,1sleep20-21swapper/223:09:432
1238715250,1sleep20-21swapper/223:00:292
1214060250,3sleep21214965-21cut22:45:152
1212445250,3sleep21212522-21ntp_states22:40:222
1201193251,2sleep10-21swapper/122:35:161
1193703250,1sleep20-21swapper/222:28:162
1187644250,1sleep10-21swapper/122:25:021
1170780250,3sleep01172889-21cut22:10:190
1149215250,1sleep00-21swapper/021:55:080
1148783250,1sleep10-21swapper/121:52:401
1132319250,2sleep00-21swapper/021:40:180
1130208250,2sleep11130402-21if_eno121:40:151
1123109250,1sleep00-21swapper/021:33:000
1116717250,1sleep10-21swapper/121:28:001
1059496250,3sleep11060293-21cut20:45:171
1051538250,3sleep10-21swapper/120:35:241
1033377250,1sleep00-21swapper/020:25:050
1001315250,1sleep10-21swapper/120:00:101
1000036250,2sleep11000161-21ntpq19:55:211
994579240,3sleep10-21swapper/119:54:241
988161240,3sleep00-21swapper/019:49:030
964068240,2sleep2965193-21kthreadcore19:30:182
964068240,2sleep2965193-21kthreadcore19:30:182
962561240,2sleep10-21swapper/119:30:011
30179840,1rtkit-daemon0-21swapper/222:20:082
1355541240,3sleep10-21swapper/100:33:161
1283927240,3sleep20-21swapper/223:39:552
1250809240,3sleep10-21swapper/123:10:171
1234344240,2sleep10-21swapper/123:00:161
1229188240,2sleep11231347-21cut22:55:191
1225202240,2sleep10-21swapper/122:50:231
1219587240,3sleep10-21swapper/122:48:061
1180303240,1sleep10-21swapper/122:15:251
1161461240,3sleep10-21swapper/122:00:461
1117130240,2sleep10-21swapper/121:30:131
1097213240,3sleep10-21swapper/121:13:371
1084188240,3sleep10-21swapper/121:00:521
1065505240,1sleep00-21swapper/020:50:130
1038833240,2sleep10-21swapper/120:25:261
988485230,1sleep00-21swapper/019:50:070
939660230,1sleep10-21swapper/119:10:211
1323263230,1sleep20-21swapper/200:10:122
1300850230,1sleep20-21swapper/223:50:172
1219985230,1sleep20-21swapper/222:50:072
1200790230,1sleep20-21swapper/222:35:092
1198640230,1sleep10-21swapper/122:30:181
1163568230,1sleep10-21swapper/122:05:191
1065490230,1sleep10-21swapper/120:50:101
1064965230,1sleep00-21swapper/020:46:320
1039772230,1sleep10-21swapper/120:30:061
1026467230,1sleep00-21swapper/020:17:040
1014282230,1sleep10-21swapper/120:10:151
1008015230,1sleep10-21swapper/120:05:181
1000344230,1sleep00-21swapper/019:55:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional