You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 00:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot8s.osadl.org (updated Fri Dec 19, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1135042992790,275cyclictest1558452-21turbostat12:39:543
1135042992471,243cyclictest1525966-21turbostat12:14:543
113504299198,8cyclictest1156567-21turbostat07:25:013
113504299175,9cyclictest1461174-21taskset11:20:003
113504299171,12cyclictest1428897-21taskset10:55:003
113504299165,8cyclictest1344326-21turbostat09:50:003
1135042991613,1cyclictest0-21swapper/308:30:013
1135042991513,1cyclictest0-21swapper/310:46:573
1135042991513,1cyclictest0-21swapper/310:46:563
1135042991513,1cyclictest0-21swapper/310:12:143
1135042991513,1cyclictest0-21swapper/309:52:203
1135042991513,1cyclictest0-21swapper/309:05:413
1135042991513,1cyclictest0-21swapper/308:47:063
1135042991513,0cyclictest0-21swapper/309:35:063
1135042991512,1cyclictest0-21swapper/312:22:463
1135042991512,1cyclictest0-21swapper/311:45:213
1135042991512,1cyclictest0-21swapper/310:26:263
1135042991512,1cyclictest0-21swapper/309:43:583
1135042991512,1cyclictest0-21swapper/308:50:173
1135042991512,1cyclictest0-21swapper/308:00:163
1135042991512,1cyclictest0-21swapper/307:45:423
1135042991512,1cyclictest0-21swapper/307:15:003
113504299151,11cyclictest1143897-21taskset07:15:113
113504299151,10cyclictest1215084-21taskset08:10:133
301798140,5rtkit-daemon1377279-21df10:15:122
301798140,4rtkit-daemon636-21snmpd08:42:052
14020742141,5sleep11402329-21awk10:30:231
113504299141,9cyclictest1519773-21taskset12:05:133
1135042991413,0cyclictest0-21swapper/310:03:373
1135042991413,0cyclictest0-21swapper/309:22:453
1135042991412,1cyclictest0-21swapper/310:15:083
1135042991412,1cyclictest0-21swapper/310:05:123
1135042991412,1cyclictest0-21swapper/309:34:533
1135042991412,1cyclictest0-21swapper/309:17:383
1135042991412,1cyclictest0-21swapper/308:30:153
1135042991412,0cyclictest0-21swapper/312:17:583
1135042991412,0cyclictest0-21swapper/311:50:163
1135042991411,1cyclictest0-21swapper/312:26:543
1135042991411,1cyclictest0-21swapper/311:12:103
1135042991411,1cyclictest0-21swapper/310:43:033
1135042991411,1cyclictest0-21swapper/310:20:123
1135042991411,1cyclictest0-21swapper/309:30:003
1135042991411,1cyclictest0-21swapper/308:17:113
113504299141,10cyclictest1552313-21taskset12:30:133
113504299141,10cyclictest1486835-21taskset11:35:233
113504299141,10cyclictest1473962-21taskset11:28:553
113504299141,10cyclictest1357252-21turbostat10:00:013
113504299135,5cyclictest11642462sleep307:30:153
113504299134,7cyclictest1201696-21taskset07:57:263
113504299131,9cyclictest1492740-21chrt11:40:213
113504299131,9cyclictest1467359-21chrt11:21:443
113504299131,9cyclictest1435690-21taskset11:00:143
113504299131,9cyclictest1273856-21taskset08:55:163
113504299131,9cyclictest1176797-21taskset07:40:163
113504299131,9cyclictest1169725-21taskset07:35:123
1135042991312,0cyclictest0-21swapper/308:23:403
1135042991312,0cyclictest0-21swapper/308:23:403
113504299131,10cyclictest1162944-21chrt07:29:103
1135042991311,0cyclictest0-21swapper/307:50:093
1135042991310,1cyclictest0-21swapper/309:10:283
113504299130,10cyclictest1474557-21chrt11:30:023
113504299130,10cyclictest1253103-21taskset08:35:263
15472902121,3sleep20-21swapper/212:25:152
15199892120,5sleep11520187-21if_eno112:05:151
14288532121,4sleep21428896-21munin-run10:55:002
12734202121,8sleep01273576-21diskstats08:55:150
113504299129,1cyclictest0-21swapper/310:35:223
113504299123,7cyclictest1512750-21taskset11:57:063
113504299121,9cyclictest1402505-21taskset10:31:483
113504299121,9cyclictest1253732-21taskset08:40:063
113504299121,8cyclictest1442027-21taskset11:05:103
113504299121,8cyclictest1208646-21taskset08:05:123
1135042991210,1cyclictest0-21swapper/309:00:163
113504299120,9cyclictest1519142-21taskset12:00:393
113504299120,10cyclictest1434462-21taskset10:55:203
301798110,6rtkit-daemon1298150-21ntp_states09:10:202
13622052111,7sleep01362650-21memory10:00:180
12865312110,4sleep21286601-21cut09:05:152
11346832110,3sleep30-21swapper/307:07:273
301798100,5rtkit-daemon448-21wpa_supplicant10:30:132
301798100,5rtkit-daemon1422051-21users10:45:252
301798100,5rtkit-daemon1422051-21users10:45:242
301798100,5rtkit-daemon1414881-21ntp_states10:40:212
301798100,5rtkit-daemon1317681-21ntpq09:25:192
15614042103,1sleep2171rcu_preempt12:35:182
30179890,4rtkit-daemon636-21snmpd12:30:342
30179890,4rtkit-daemon636-21snmpd11:30:132
30179890,4rtkit-daemon1481615-21sed11:35:152
30179890,4rtkit-daemon1272288-21ntp_states08:50:222
30179890,4rtkit-daemon1221268-21munin-run08:15:002
30179890,1rtkit-daemon0-21swapper/211:14:332
30179890,1rtkit-daemon0-21swapper/208:23:212
30179890,1rtkit-daemon0-21swapper/208:23:212
1564843291,5sleep01564849-21cron12:40:010
1466800291,4sleep11466925-21python311:20:231
1416204290,4sleep11415736-21apt-get10:45:011
1416204290,4sleep11415736-21apt-get10:45:011
1370693290,6sleep11370745-21grep10:10:121
1247280291,4sleep11247313-21apt-get08:35:121
1240862291,4sleep11240895-21apt-get08:30:111
1141919290,6sleep01143118-21cat07:15:010
30179880,5rtkit-daemon667-21lldpd09:03:582
30179880,5rtkit-daemon636-21snmpd10:38:462
30179880,5rtkit-daemon430-21avahi-daemon08:03:102
30179880,5rtkit-daemon3205-21sendmail-mta11:42:352
30179880,4rtkit-daemon667-21lldpd10:57:142
30179880,4rtkit-daemon667-21lldpd09:46:292
30179880,4rtkit-daemon638-21ntpd12:00:122
30179880,4rtkit-daemon638-21ntpd10:05:122
30179880,4rtkit-daemon638-21ntpd08:55:232
30179880,4rtkit-daemon638-21ntpd08:05:132
30179880,4rtkit-daemon636-21snmpd11:45:522
30179880,4rtkit-daemon636-21snmpd11:09:362
30179880,4rtkit-daemon636-21snmpd10:27:472
30179880,4rtkit-daemon636-21snmpd09:16:212
30179880,4rtkit-daemon636-21snmpd08:37:202
30179880,4rtkit-daemon636-21snmpd08:15:112
30179880,4rtkit-daemon492-21gmain12:21:022
30179880,4rtkit-daemon492-21gmain11:21:492
30179880,4rtkit-daemon448-21wpa_supplicant10:23:232
30179880,4rtkit-daemon448-21wpa_supplicant07:52:162
30179880,4rtkit-daemon3205-21sendmail-mta10:03:152
30179880,4rtkit-daemon3200908-21packagekitd08:45:492
30179880,4rtkit-daemon297-21systemd-journal07:59:552
30179880,4rtkit-daemon1440934-21ntp_states11:00:222
30179880,4rtkit-daemon1141606-21munin-node11:52:332
30179880,4rtkit-daemon1141606-21munin-node07:40:202
30179880,4rtkit-daemon1141606-21munin-node07:26:412
30179880,4rtkit-daemon1128762-21/usr/sbin/munin07:05:152
30179880,4rtkit-daemon0-21swapper/212:16:222
30179880,1rtkit-daemon0-21swapper/209:35:572
30179880,1rtkit-daemon0-21swapper/209:31:402
30179880,1rtkit-daemon0-21swapper/207:39:522
1552470280,6sleep01552633-21tail12:30:140
1544686281,4sleep01544745-21ntp_states12:20:200
1506796281,3sleep01506829-21apt-get11:55:130
1499416281,4sleep01499636-21unixbench_multi11:45:220
1481043281,4sleep01481199-21diskstats11:35:130
1442219281,4sleep11442350-21gltestperf11:05:131
1388885281,4sleep01388949-21ntp_states10:20:200
1378554281,5sleep11379997-21kthreadcore10:15:171
1356410281,4sleep01356535-21python309:55:200
1312775280,5sleep01313156-21sed09:25:150
1293290281,4sleep01294289-21sed09:10:170
1239240281,4sleep11239671-21grep08:25:191
1229097280,6sleep11230230-21cut08:20:171
1229097280,6sleep11230230-21cut08:20:171
1189272281,3sleep11189294-21apt-get07:50:131
1149160280,4sleep21149218-21ntp_states07:15:192
30179870,4rtkit-daemon492-21gmain12:13:252
30179870,4rtkit-daemon1141606-21munin-node11:15:032
30179870,4rtkit-daemon1141606-21munin-node10:10:042
30179870,3rtkit-daemon638-21ntpd07:21:162
30179870,3rtkit-daemon636-21snmpd12:05:222
30179870,3rtkit-daemon636-21snmpd08:31:142
30179870,3rtkit-daemon492-21gmain09:55:092
30179870,3rtkit-daemon3200908-21packagekitd07:30:392
30179870,3rtkit-daemon317-21systemd-udevd09:41:332
30179870,3rtkit-daemon1347537-21kthreadcore09:50:162
30179870,3rtkit-daemon1186075-21kthreadcore07:45:172
30179870,3rtkit-daemon1141606-21munin-node08:26:432
30179870,1rtkit-daemon0-21swapper/211:26:072
1539441270,4sleep11539596-21diskstats12:20:141
1532670270,4sleep11532825-21diskstats12:15:121
1508675270,4sleep21510697-21grep11:55:192
1501341271,3sleep10-21swapper/111:50:161
1487526271,3sleep01487672-21df11:40:140
1474971271,3sleep11475512-21irqcore11:30:171
1454921270,3sleep11454956-21apt-get11:15:111
1439551270,4sleep01440740-21memory11:00:190
1390081271,3sleep01390236-21diskstats10:25:130
1377557270,4sleep01378553-21irqstats10:15:160
1357946271,3sleep10-21swapper/110:00:151
1350746270,1sleep00-21swapper/009:54:440
1346696270,4sleep11348796-21grep09:50:161
1279895270,3sleep11279921-21apt-get09:00:121
1228357271,3sleep01229095-21irqrtprio08:20:170
1228357271,3sleep01229095-21irqrtprio08:20:160
1227665270,4sleep01227794-21latency_hist08:20:000
1215241270,4sleep01215433-21head08:10:150
1182800270,3sleep11182833-21apt-get07:45:111
1177769270,5sleep01178905-21kthreadcore07:40:190
1135392270,4sleep21135591-21hddtemp_smartct07:10:162
30179860,3rtkit-daemon492-21gmain09:22:022
1532355260,1sleep00-21swapper/012:14:440
1513449260,4sleep11513649-21hddtemp_smartct12:00:141
1513292260,3sleep01513448-21diskstats12:00:130
1506832260,3sleep11506975-21df11:55:141
1462765261,2sleep01463944-21kthreadcore11:20:180
1447912260,1sleep00-21swapper/011:06:120
1411009260,3sleep11413012-21grep10:40:181
1404465260,3sleep11405862-21grep10:35:161
1385685261,2sleep10-21swapper/110:20:171
1344020260,1sleep10-21swapper/109:46:211
1331706261,2sleep00-21swapper/009:40:140
1262142260,4sleep01264197-21cut08:45:160
1253741261,2sleep01253774-21apt-get08:40:130
1247485260,3sleep01247666-21head08:35:150
1246854260,1sleep00-21swapper/008:32:500
1214601260,1sleep10-21swapper/108:07:361
1169430260,1sleep10-21swapper/107:34:301
1156802260,3sleep01156837-21apt-get07:25:120
1141285260,1sleep00-21swapper/007:12:580
1129620262,2sleep01130582-21kthreadcore07:05:160
1560138250,3sleep11561403-21cut12:35:171
1558423250,1sleep10-21swapper/112:34:561
1551973250,1sleep00-21swapper/012:29:260
1532639250,2sleep01532667-21apt-get12:15:110
1532174250,1sleep10-21swapper/112:12:241
1500360250,2sleep00-21swapper/011:50:110
1493923250,2sleep10-21swapper/111:45:111
1490204250,3sleep11492374-21kthreadcore11:40:201
1487117250,1sleep10-21swapper/111:38:501
1480447250,1sleep00-21swapper/011:31:090
1448456250,3sleep00-21swapper/011:10:050
1435025250,1sleep00-21swapper/010:56:180
1428781250,1sleep00-21swapper/010:54:070
1428664250,1sleep10-21swapper/110:52:351
1417040250,3sleep01417955-21cut10:45:160
1417040250,3sleep01417955-21cut10:45:160
1415434250,1sleep00-21swapper/010:41:210
1403009250,2sleep01403044-21apt-get10:35:110
1369919250,1sleep10-21swapper/110:07:071
1338331250,3sleep00-21swapper/009:45:140
1333286250,2sleep11335328-21kthreadcore09:40:191
1324752250,1sleep00-21swapper/009:31:520
1319210250,2sleep10-21swapper/109:30:131
1298922250,1sleep10-21swapper/109:14:061
1292246250,1sleep00-21swapper/009:06:250
1273577251,2sleep10-21swapper/108:55:151
1272992250,1sleep10-21swapper/108:53:191
1272902250,1sleep00-21swapper/008:52:100
1254675251,2sleep10-21swapper/108:40:181
1201855250,1sleep00-21swapper/007:59:290
1201552250,1sleep10-21swapper/107:55:371
1195458250,3sleep01195567-21latency_hist07:55:010
1188946250,1sleep00-21swapper/007:49:150
1178907250,2sleep1321rcuc/107:40:191
1175774250,1sleep00-21swapper/007:38:250
1169204250,1sleep00-21swapper/007:31:360
1156252250,1sleep10-21swapper/107:21:111
1150777251,2sleep00-21swapper/007:20:140
1141261250,1sleep10-21swapper/107:12:391
1467870240,3sleep10-21swapper/111:25:121
1435593240,2sleep11435626-21apt-get11:00:131
1390237240,2sleep10-21swapper/110:25:151
1376586240,3sleep00-21swapper/010:11:430
1369851240,3sleep00-21swapper/010:06:140
1357178240,3sleep10-21swapper/109:59:221
1326432240,2sleep00-21swapper/009:35:180
1318206240,3sleep10-21swapper/109:25:281
1310889240,2sleep11311198-21strings09:20:201
1299903240,2sleep10-21swapper/109:15:141
1287800240,2sleep11289046-21grep09:05:181
1234587240,1sleep00-21swapper/008:25:140
1215434240,2sleep11215557-21cut08:10:161
1211287240,2sleep01213400-21kthreadcore08:05:190
1206395241,1sleep10-21swapper/108:00:181
1171601240,2sleep10-21swapper/107:35:191
1149412240,1sleep10-21swapper/107:15:221
1130586240,1sleep10-21swapper/107:05:171
1545835230,1sleep10-21swapper/112:25:101
1519723230,1sleep00-21swapper/012:05:020
1468854230,1sleep00-21swapper/011:25:190
1454833230,1sleep00-21swapper/011:15:020
1449204230,1sleep10-21swapper/111:10:181
1434213230,1sleep10-21swapper/110:55:191
1396729230,1sleep00-21swapper/010:30:140
1325434230,1sleep10-21swapper/109:35:141
1305937230,1sleep00-21swapper/009:20:070
1299057230,1sleep00-21swapper/009:15:010
1279887230,1sleep00-21swapper/009:00:110
1260132230,1sleep10-21swapper/108:45:011
1221730230,1sleep10-21swapper/108:15:131
1202164230,1sleep00-21swapper/008:00:050
1157785230,1sleep10-21swapper/107:25:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional