You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 14:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Mon Mar 16, 2026 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9294479913260,1322cyclictest13361202sleep300:05:023
9294479912950,1291cyclictest12704832sleep323:20:013
9294479912890,1286cyclictest12048922sleep322:35:023
9294479911220,1118cyclictest10128342sleep320:14:573
9294479911140,1110cyclictest10820282sleep321:10:023
929447992522,1cyclictest0-21swapper/321:40:003
72699240,7ntpd982013-21apt-get19:50:120
72699240,7ntpd1277803-21apt-get23:25:121
161998240,9rtkit-daemon0-21swapper/200:13:072
72699230,6ntpd1080906-21ntpq21:05:202
72699230,6ntpd1030727-21ntpq20:25:232
72699230,5ntpd1314214-21ssh23:50:112
72699220,8ntpd1282981-21ld23:25:200
72699220,8ntpd1166562-21grep22:05:180
72699220,7ntpd1081790-21diskmemload00:37:450
72699220,6ntpd993339-21ntp_states19:55:210
72699220,6ntpd1255834-21apt-get23:10:132
72699220,6ntpd1188468-21ntpq22:20:220
72699220,6ntpd1147112-21apt-get21:55:140
72699220,6ntpd1132607-21apt-get21:45:110
72699220,6ntpd1103772-21apt-get21:25:132
72699220,6ntpd1081790-21diskmemload21:38:511
72699220,6ntpd1068386-21ntpq20:55:181
72699220,6ntpd1057131-21apt-get20:50:120
72699220,6ntpd1005665-21ntpq20:05:192
72699220,5ntpd923196-21apt-get19:05:130
72699220,5ntpd1176032-21apt-get22:15:112
72699220,5ntpd1130444-21ntpq21:40:201
72699220,5ntpd1049738-21ntpq20:40:200
72699220,12ntpd1094376-21awk21:15:191
10401512220,1sleep00-21swapper/020:35:170
72699210,7ntpd1145071-21ssh21:50:210
72699210,7ntpd1131189-21ssh21:40:520
72699210,6ntpd980577-21ntpq19:45:211
72699210,6ntpd976837-21irqstats19:45:150
72699210,6ntpd1379841-21apt-get00:35:131
72699210,6ntpd1270858-21hddtemp_smartct23:20:142
72699210,6ntpd1239378-21ntp_states22:55:220
72699210,6ntpd1188363-21ntpq22:20:201
72699210,6ntpd1130496-21ntpq21:40:212
72699210,6ntpd1103937-21df_inode21:25:130
72699210,6ntpd1081790-21diskmemload00:09:510
72699210,6ntpd1024668-21python320:20:242
72699210,6ntpd1018227-21ntp_states20:15:222
72699210,5ntpd999574-21ntp_states20:00:242
72699210,5ntpd981478-21apt-get19:50:012
72699210,5ntpd950520-21apt-get19:25:120
72699210,5ntpd929723-21apt-get19:10:120
72699210,5ntpd1306976-21apt-get23:45:121
72699210,5ntpd1239268-21ntpq22:55:201
72699210,5ntpd1081790-21diskmemload21:33:531
72699210,5ntpd1068445-21ntp_states20:55:192
72699210,5ntpd1044613-21apt-get20:40:101
72699210,2ntpd0-21swapper/219:15:022
72699200,7ntpd1341317-21sh00:05:191
72699200,7ntpd1248921-21/usr/sbin/munin23:05:160
72699200,7ntpd1248921-21/usr/sbin/munin23:05:150
72699200,7ntpd1103234-21ssh21:24:142
72699200,7ntpd1081790-21diskmemload22:25:202
72699200,6ntpd993155-21grep19:55:182
72699200,6ntpd1297487-21memory23:35:200
72699200,6ntpd1197662-21ssh22:30:010
72699200,6ntpd1081790-21diskmemload22:48:020
72699200,5ntpd961860-21ntpq19:30:221
72699200,5ntpd930007-21hddtemp_smartct19:10:142
72699200,5ntpd1385070-21ntpq00:35:232
72699200,5ntpd1321584-21df_inode23:55:140
72699200,5ntpd1312172-21ntpq23:45:220
72699200,5ntpd1260886-21ntpq23:10:190
72699200,5ntpd1152177-21ntpq21:55:222
72699200,5ntpd1115874-21memory21:30:190
72699200,5ntpd1055995-21ntp_states20:45:232
72699200,5ntpd1055995-21ntp_states20:45:222
72699200,5ntpd1000705-21apt-get20:05:110
72699200,4ntpd938051-21apt-get19:15:110
72699200,4ntpd1362929-21ssh00:20:212
72699200,4ntpd1355700-21ntpq00:15:201
72699200,4ntpd1335631-21apt-get00:05:032
72699200,4ntpd1211902-21apt-get22:40:012
72699200,4ntpd1204963-21apt-get22:35:111
72699200,4ntpd1025645-21apt-get20:25:131
72699200,3ntpd1292568-21ssh23:35:132
72699200,2ntpd0-21swapper/220:10:202
72699200,2ntpd0-21swapper/200:00:132
161998200,1rtkit-daemon0-21swapper/220:41:302
72699190,8ntpd1033253-21kthreadcore20:30:172
72699190,8ntpd1033253-21kthreadcore20:30:172
72699190,7ntpd1225682-21kworker/u16:0+xprtiod22:59:172
72699190,6ntpd1374644-21grep00:30:160
72699190,6ntpd1263461-21df23:15:122
72699190,6ntpd1166233-21cut22:05:171
72699190,6ntpd1085507-21cut21:10:171
72699190,6ntpd1014279-21irqrtprio20:15:170
72699190,5ntpd950989-21cut19:25:151
72699190,5ntpd1355790-21ntp_states00:15:222
72699190,5ntpd1285225-21diskstats23:30:130
72699190,5ntpd1275775-21ntpq23:20:221
72699190,5ntpd1243860-21ssh23:00:160
72699190,5ntpd1175529-21ssh22:14:221
72699190,5ntpd1168645-21cut22:10:002
72699190,5ntpd1124135-21ssh21:36:280
72699190,5ntpd1094423-21ntpq21:15:200
72699190,5ntpd1081790-21diskmemload23:40:211
72699190,5ntpd1077199-21irqstats21:05:150
72699190,5ntpd1008305-21grep20:10:171
72699190,5ntpd1006670-21munin-run20:10:001
72699190,4ntpd968017-21awk19:35:201
72699190,4ntpd1364387-21ssh00:23:371
72699190,4ntpd1355763-21ntpq00:15:210
72699190,4ntpd1348516-21ntpq00:10:200
72699190,4ntpd1291801-21ssh23:34:242
72699190,4ntpd1283022-21ssh23:25:222
72699190,4ntpd1268471-21ntp_states23:15:220
72699190,4ntpd1246525-21ntpq23:00:202
72699190,4ntpd1232104-21ntpq22:50:220
72699190,4ntpd1081790-21diskmemload23:56:361
72699190,4ntpd1069618-21apt-get21:00:100
72699190,4ntpd1050873-21apt-get20:45:131
72699190,4ntpd1050873-21apt-get20:45:121
72699190,3ntpd1343438-21ssh00:10:121
72699190,3ntpd1212492-21ssh22:40:111
72699190,3ntpd1190511-21apt-get22:25:121
72699190,3ntpd1154355-21ssh22:00:122
72699190,3ntpd1144977-21ssh21:50:202
92944799187,8cyclictest1132614-21taskset21:45:113
72699180,7ntpd0-21swapper/022:27:250
72699180,6ntpd962961-21/usr/sbin/munin19:35:212
72699180,6ntpd0-21swapper/000:01:420
72699180,5ntpd1378782-21ssh00:32:172
72699180,5ntpd1319362-21ntp_offset23:50:200
72699180,5ntpd1285524-21sed23:30:141
72699180,4ntpd999653-21cut20:00:250
72699180,4ntpd936195-21ntpq19:15:021
72699180,4ntpd934858-21ld19:10:211
72699180,4ntpd1303058-21ssh23:40:180
72699180,4ntpd1301616-21grep23:40:172
72699180,4ntpd1274285-21kthreadcore23:20:170
72699180,4ntpd1137685-21ssh21:45:201
72699180,4ntpd1094530-21ssh21:15:212
72699180,3ntpd1203630-21ssh22:31:122
72699180,3ntpd0-21swapper/219:25:212
72699180,2ntpd0-21swapper/119:40:201
72699180,1ntpd0-21swapper/021:20:200
92944799176,8cyclictest1328721-21taskset00:00:123
92944799172,11cyclictest1182969-21turbostat22:19:593
92944799171,12cyclictest1357518-21taskset00:19:563
72699170,5ntpd1088407-21ssh21:12:462
72699170,5ntpd1075455-21kworker/u16:1+rpciod21:38:102
72699170,5ntpd0-21swapper/020:10:220
72699170,4ntpd994213-21/usr/sbin/munin20:00:001
72699170,4ntpd957207-21sed19:30:162
72699170,4ntpd1365435-21if_err_eno100:25:141
72699170,4ntpd1363719-21ssh00:21:110
72699170,4ntpd1327415-21ssh23:56:242
72699170,4ntpd1232839-21ssh22:51:112
72699170,4ntpd1232073-21ssh22:50:211
72699170,4ntpd1210871-21taskset22:36:120
72699170,4ntpd1182069-21ssh22:16:441
72699170,4ntpd1108870-21ssh21:25:221
72699170,4ntpd1069757-21expr21:00:111
72699170,3ntpd988040-21latency_hist19:55:001
72699170,3ntpd1277436-21kworker/u16:4-nfsiod23:50:191
72699170,3ntpd1168740-21ssh22:10:032
72699170,3ntpd1081790-21diskmemload22:34:291
72699170,3ntpd1081790-21diskmemload22:00:071
72699170,3ntpd1035255-21cut20:30:190
72699170,3ntpd1035255-21cut20:30:180
92944799166,7cyclictest1096269-21turbostat21:20:003
929447991614,1cyclictest0-21swapper/319:15:213
92944799161,11cyclictest944332-21taskset19:20:103
92944799161,11cyclictest1161614-21taskset22:05:123
92944799161,11cyclictest1096599-21taskset21:20:113
72699160,6ntpd923157-21taskset19:05:072
72699160,5ntpd1102945-21ssh21:23:041
72699160,4ntpd960202-21kthreadcore19:30:170
72699160,4ntpd0-21swapper/020:55:140
72699160,3ntpd929440-21cyclictest21:32:082
72699160,3ntpd1370810-21ssh00:25:412
72699160,3ntpd1370178-21ssh00:25:210
72699160,3ntpd1334891-21ssh00:02:171
72699160,3ntpd1320018-21kworker/u16:3+xprtiod00:30:051
72699160,3ntpd1292530-21/usr/sbin/munin23:35:171
72699160,3ntpd1251652-21grep23:05:192
72699160,3ntpd1251652-21grep23:05:182
72699160,3ntpd1211210-21ssh22:37:272
72699160,3ntpd1189283-21ssh22:21:372
72699160,3ntpd1147167-21ssh21:55:151
72699160,3ntpd1136255-21kthreadcore21:45:172
72699160,3ntpd1081790-21diskmemload21:13:080
72699160,3ntpd1023188-21kthreadcore20:20:180
72699160,3ntpd0-21swapper/121:05:191
72699160,2ntpd1312165-21ssh23:45:222
72699160,2ntpd1255997-21ssh23:10:131
72699160,2ntpd1062212-21ntpq20:50:211
72699160,2ntpd0-21swapper/222:49:152
72699160,2ntpd0-21swapper/122:45:171
72699160,2ntpd0-21swapper/120:15:231
72699160,2ntpd0-21swapper/022:15:210
72699160,2ntpd0-21swapper/020:45:230
72699160,2ntpd0-21swapper/020:45:220
92944799157,6cyclictest987976-21turbostat19:59:553
92944799155,7cyclictest1386409-21taskset00:38:363
92944799155,7cyclictest13716942sleep300:28:593
92944799155,7cyclictest12928592sleep323:35:173
92944799154,8cyclictest1062241-21taskset20:50:223
92944799151,9cyclictest9692142sleep319:40:113
929447991513,0cyclictest0-21swapper/323:05:093
929447991513,0cyclictest0-21swapper/323:05:093
929447991513,0cyclictest0-21swapper/321:42:593
929447991512,1cyclictest0-21swapper/322:40:313
929447991512,1cyclictest0-21swapper/321:58:553
92944799151,11cyclictest1173931-21taskset22:10:203
92944799151,10cyclictest950523-21taskset19:25:113
92944799151,10cyclictest9293742sleep319:10:023
92944799151,10cyclictest1236458-21taskset22:55:163
92944799151,10cyclictest1159552-21taskset22:00:223
72699150,3ntpd971975-21grep19:40:160
72699150,3ntpd1268344-21ssh23:15:201
72699150,3ntpd1254471-21ssh23:06:091
72699150,3ntpd1254471-21ssh23:06:081
72699150,3ntpd1146089-21ssh21:52:231
72699150,2ntpd0-21swapper/221:00:202
72699150,2ntpd0-21swapper/220:35:202
72699150,2ntpd0-21swapper/219:45:122
72699150,2ntpd0-21swapper/219:40:112
72699150,2ntpd0-21swapper/219:20:202
72699150,2ntpd0-21swapper/120:35:221
72699150,2ntpd0-21swapper/120:30:221
72699150,2ntpd0-21swapper/120:30:221
72699150,2ntpd0-21swapper/120:20:211
72699150,2ntpd0-21swapper/119:20:111
72699150,2ntpd0-21swapper/119:05:221
72699150,2ntpd0-21swapper/022:10:210
72699150,2ntpd0-21swapper/022:00:210
72699150,2ntpd0-21swapper/019:20:210
72699150,1ntpd0-21swapper/123:04:541
92944799145,6cyclictest1117373-21taskset21:33:093
92944799144,7cyclictest968606-21taskset19:35:453
92944799143,8cyclictest1019391-21taskset20:20:133
92944799141,9cyclictest1268917-21taskset23:15:243
92944799141,9cyclictest11956092sleep322:25:203
929447991412,1cyclictest0-21swapper/323:45:443
929447991412,1cyclictest0-21swapper/322:24:203
929447991411,1cyclictest0-21swapper/323:56:113
929447991411,1cyclictest0-21swapper/320:00:483
92944799141,10cyclictest1357901-21taskset00:20:133
92944799141,10cyclictest1319992-21taskset23:50:483
92944799141,10cyclictest1305567-21chrt23:40:543
92944799141,10cyclictest1285001-21chrt23:30:033
92944799141,10cyclictest1261800-21taskset23:11:283
92944799141,10cyclictest1222146-21taskset22:45:143
92944799141,10cyclictest1145893-21chrt21:51:413
92944799141,10cyclictest1036957-21taskset20:30:223
92944799141,10cyclictest1036957-21taskset20:30:223
92944799140,11cyclictest1044328-21turbostat20:40:013
92944799140,10cyclictest1197744-21chrt22:30:123
92944799140,10cyclictest1013130-21taskset20:15:123
72699140,2ntpd0-21swapper/022:40:130
72699140,1ntpd0-21swapper/019:35:130
92944799133,7cyclictest9805172sleep319:45:213
92944799131,9cyclictest983173-21taskset19:50:163
92944799131,9cyclictest1343361-21chrt00:10:023
92944799131,9cyclictest1226872-21taskset22:50:033
92944799131,9cyclictest1103779-21taskset21:25:133
92944799131,9cyclictest1075227-21taskset21:00:393
92944799131,9cyclictest1068938-21chrt20:55:243
92944799131,9cyclictest1031227-21taskset20:25:303
929447991312,0cyclictest0-21swapper/323:02:223
929447991311,1cyclictest0-21swapper/321:08:443
92944799131,10cyclictest1056713-21taskset20:48:213
92944799131,10cyclictest1056713-21taskset20:48:213
929447991310,1cyclictest0-21swapper/319:32:023
929447991310,1cyclictest0-21swapper/300:30:133
92944799130,10cyclictest1277751-21taskset23:25:073
92944799130,10cyclictest1050245-21chrt20:40:403
92944799130,10cyclictest1005585-21taskset20:05:183
72699130,1ntpd0-21swapper/020:27:310
72699120,2ntpd0-21swapper/120:03:281
72699120,1ntpd0-21swapper/220:50:152
928166280,4sleep30-21swapper/319:05:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional