You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 13:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Tue Jul 07, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
991197995245,5cyclictest1256158-21latency_hist23:30:011
991205994942,5cyclictest1204735-21latency_hist22:40:013
99119499490,48cyclictest509-21rs:main0
991194994744,2cyclictest1215028-21kworker/u8:2+events_unbound23:05:020
991200994537,3cyclictest1012644-21kworker/u8:1+events_unbound19:55:012
991194994540,4cyclictest1152712-21latency_hist21:50:010
991194994441,2cyclictest1173538-21kworker/u8:3+events_unbound23:45:000
991200994339,3cyclictest1121118-21kworker/u8:1+events_unbound22:05:122
991194994138,2cyclictest996971-21kworker/u8:0+events_unbound19:33:180
991200994037,2cyclictest1064705-21kworker/u8:3+events_unbound20:25:152
991197994034,4cyclictest1094751-21ntpq20:50:221
991194994037,2cyclictest1173538-21kworker/u8:3+events_unbound23:30:270
991205993933,4cyclictest1064705-21kworker/u8:3+flush-259:020:45:173
991194993936,2cyclictest996971-21kworker/u8:0+events_unbound19:39:170
991200993835,2cyclictest1064705-21kworker/u8:3+events_unbound21:25:202
991200993835,2cyclictest1064705-21kworker/u8:3+events_unbound21:25:192
991194993836,2cyclictest1121118-21kworker/u8:1+events_unbound21:56:280
991194993833,4cyclictest335557-21systemd-journal23:55:010
991200993734,2cyclictest1064705-21kworker/u8:3+flush-259:020:45:212
991200993731,4cyclictest1282070-21kworker/u8:1+events_unbound23:55:202
991194993734,2cyclictest1173538-21kworker/u8:3+events_unbound22:34:260
991200993633,2cyclictest985984-21kworker/u8:2+events_unbound19:15:202
991200993630,4cyclictest991790-21latency_hist19:15:012
991197993631,3cyclictest985984-21kworker/u8:2+flush-259:019:30:161
991194993633,2cyclictest1074980-21kworker/u8:0+events_unbound21:00:240
991194993632,3cyclictest1287428-21apt-get23:59:590
991205993527,5cyclictest1074963-21latency_hist20:35:013
991200993531,3cyclictest1105955-21kworker/u8:2+events_unbound21:05:222
991200993531,3cyclictest1064705-21kworker/u8:3+events_unbound20:55:252
991200993528,5cyclictest1260387-21ntpq23:30:212
991197993528,4cyclictest1157867-21latency_hist21:55:001
991194993532,3cyclictest1282070-21kworker/u8:1+events_unbound00:24:370
991194993532,2cyclictest1215028-21kworker/u8:2+events_unbound23:00:270
991197993431,2cyclictest1173538-21kworker/u8:3+flush-259:022:45:231
991194993431,2cyclictest1121118-21kworker/u8:1+events_unbound22:36:290
991194993431,2cyclictest1064705-21kworker/u8:3+events_unbound21:27:260
991194993431,2cyclictest1064705-21kworker/u8:3+events_unbound21:27:260
991200993330,2cyclictest1173538-21kworker/u8:3+events_unbound00:00:192
991194993331,2cyclictest966025-21kworker/u8:1+events_unbound19:17:170
991205993226,4cyclictest1303339-21latency_hist00:15:013
991200993229,2cyclictest1121118-21kworker/u8:1+events_unbound22:35:232
991200993228,3cyclictest1012644-21kworker/u8:1+events_unbound19:45:242
991205993126,3cyclictest1012644-21kworker/u8:1+flush-259:020:00:003
991200993128,2cyclictest1215028-21kworker/u8:2+events_unbound23:05:232
991200993128,2cyclictest1173538-21kworker/u8:3+flush-259:023:20:222
991200993126,4cyclictest1266405-21apt-get23:39:592
991197993128,2cyclictest1028317-21kworker/u8:2+events_unbound20:25:011
991197993124,5cyclictest1240715-21latency_hist23:15:011
991197993123,5cyclictest1266403-21latency_hist23:40:011
991194993127,3cyclictest1023371-21apt-get19:45:090
991205993024,4cyclictest1007252-21apt-get19:30:003
991200993027,2cyclictest1292696-21kworker/u8:2+events_unbound00:30:192
991200993027,2cyclictest1064705-21kworker/u8:3+flush-259:020:50:232
991200993026,3cyclictest1121118-21kworker/u8:1+flush-259:021:40:262
991200993026,3cyclictest1121118-21kworker/u8:1+events_unbound22:35:012
991200993024,4cyclictest991118-21latency_hist19:10:002
991194993026,3cyclictest1215028-21kworker/u8:2+flush-259:022:55:270
991200992926,2cyclictest1173538-21kworker/u8:3+flush-259:022:15:212
991200992926,2cyclictest1105955-21kworker/u8:2+events_unbound21:10:242
991200992925,3cyclictest1173538-21kworker/u8:3+flush-259:023:10:162
991200992924,2cyclictest1173538-21kworker/u8:3+events_unbound22:50:142
991200992923,2cyclictest1121118-21kworker/u8:1+events_unbound22:00:002
991197992925,3cyclictest1105955-21kworker/u8:2+events_unbound21:10:211
991197992924,4cyclictest1132379-21apt-get21:30:131
991194992927,2cyclictest1292696-21kworker/u8:2+events_unbound00:03:370
991194992926,2cyclictest985985-21kworker/u8:4+events_unbound19:40:260
991194992926,2cyclictest1142664-21kworker/u8:0+flush-259:022:15:010
991205992823,3cyclictest1105955-21kworker/u8:2+flush-259:021:40:013
991205992822,4cyclictest1043706-21latency_hist20:05:013
991200992825,2cyclictest985985-21kworker/u8:4+flush-259:019:40:162
991200992825,2cyclictest1215028-21kworker/u8:2+flush-259:023:45:272
991200992825,2cyclictest1012644-21kworker/u8:1+events_unbound20:35:162
991200992824,3cyclictest1105955-21kworker/u8:2+events_unbound21:15:172
991200992823,4cyclictest509-21rs:main2
991197992823,3cyclictest1074980-21kworker/u8:0+flush-259:021:00:291
991205992721,4cyclictest1267252-21diskstats23:40:143
991205992721,4cyclictest1183874-21apt-get22:20:113
991200992724,2cyclictest1173538-21kworker/u8:3+events_unbound22:10:132
991200992724,2cyclictest1121118-21kworker/u8:1+flush-259:022:40:162
991200992723,3cyclictest1215028-21kworker/u8:2+flush-259:023:50:262
991197992723,2cyclictest1142664-21kworker/u8:0+flush-259:022:20:151
991197992722,3cyclictest1173538-21kworker/u8:3+flush-259:022:50:151
991194992725,2cyclictest1142664-21kworker/u8:0+events_unbound22:05:260
991194992724,2cyclictest1064705-21kworker/u8:3+events_unbound20:57:110
991205992621,4cyclictest1282070-21kworker/u8:1+flush-259:000:05:013
991205992620,4cyclictest1048846-21latency_hist20:10:013
991200992623,2cyclictest1292696-21kworker/u8:2+events_unbound00:20:002
991200992622,3cyclictest1064705-21kworker/u8:3+flush-259:021:50:192
991200992621,4cyclictest996971-21kworker/u8:0+events_unbound19:20:142
991197992622,3cyclictest985985-21kworker/u8:4+events_unbound19:55:171
991197992621,4cyclictest1298463-21apt-get00:10:111
991205992520,3cyclictest1064705-21kworker/u8:3+flush-259:021:25:003
991205992519,4cyclictest335557-21systemd-journal21:10:003
991200992522,2cyclictest985985-21kworker/u8:4+events_unbound19:35:212
991200992522,2cyclictest1173538-21kworker/u8:3+flush-259:023:00:212
991200992521,3cyclictest1105955-21kworker/u8:2+events_unbound21:30:282
991200992519,4cyclictest335557-21systemd-journal21:38:272
991197992521,3cyclictest985985-21kworker/u8:4+events_unbound19:50:201
991197992521,3cyclictest1292696-21kworker/u8:2+flush-259:000:05:161
991197992521,3cyclictest1282070-21kworker/u8:1+flush-259:023:55:161
991197992521,3cyclictest1178494-21kworker/u8:4+flush-259:022:25:151
991197992520,3cyclictest1018188-21/usr/sbin/munin19:40:191
991197992519,4cyclictest1173544-21/usr/sbin/munin22:10:161
991194992522,2cyclictest1121118-21kworker/u8:1+events_unbound21:20:080
991194992519,4cyclictest1251420-21diskstats23:25:160
99119499251,22cyclictest509-21rs:main0
991200992421,2cyclictest1292696-21kworker/u8:2+flush-259:000:05:272
991200992419,2cyclictest1012644-21kworker/u8:1+events_unbound20:05:162
991197992421,2cyclictest1142664-21kworker/u8:0+flush-259:021:45:241
991194992421,2cyclictest1121118-21kworker/u8:1+events_unbound21:34:570
991194992417,5cyclictest1069012-21ntpq20:25:230
991205992319,2cyclictest0-21swapper/323:24:593
991205992317,4cyclictest1235837-21apt-get23:10:113
991200992320,2cyclictest1215028-21kworker/u8:2+flush-259:023:40:122
991200992320,2cyclictest1215028-21kworker/u8:2+flush-259:023:25:382
991200992320,2cyclictest1215028-21kworker/u8:2+flush-259:022:55:212
991200992320,2cyclictest1121118-21kworker/u8:1+events_unbound21:20:132
991200992320,2cyclictest1028317-21kworker/u8:2+events_unbound20:15:142
991197992319,3cyclictest1121118-21kworker/u8:1+events_unbound21:20:231
991194992321,2cyclictest1064705-21kworker/u8:3+events_unbound21:18:340
991194992321,2cyclictest1012644-21kworker/u8:1+events_unbound19:55:030
991194992320,2cyclictest1292696-21kworker/u8:2+events_unbound00:38:380
991194992320,2cyclictest1142664-21kworker/u8:0+events_unbound22:22:240
991194992320,2cyclictest1121118-21kworker/u8:1+events_unbound22:28:200
991194992316,5cyclictest335557-21systemd-journal21:53:260
991205992217,3cyclictest509-21rs:main3
991205992216,4cyclictest1292696-21kworker/u8:2+flush-259:000:25:013
991200992219,2cyclictest985984-21kworker/u8:2+flush-259:019:30:232
991200992219,2cyclictest1064705-21kworker/u8:3+events_unbound22:00:152
991200992218,3cyclictest1064705-21kworker/u8:3+events_unbound21:00:012
991197992218,3cyclictest1012644-21kworker/u8:1+events_unbound20:10:201
991197992214,6cyclictest335557-21systemd-journal21:00:001
991194992220,1cyclictest1292696-21kworker/u8:2+events_unbound00:29:550
991194992219,2cyclictest1215028-21kworker/u8:2+events_unbound22:52:550
991194992219,2cyclictest1173538-21kworker/u8:3+events_unbound23:20:370
991194992219,2cyclictest1043727-21kworker/u8:0+events_unbound20:18:210
991194992219,2cyclictest1012644-21kworker/u8:1+events_unbound19:52:420
991194992215,6cyclictest1084412-21ntpq20:40:210
991205992115,4cyclictest1017085-21ntpq19:35:213
991205992114,4cyclictest1111293-21apt-get21:10:133
991200992119,2cyclictest1074980-21kworker/u8:0+events_unbound20:40:142
991200992118,2cyclictest1292696-21kworker/u8:2+events_unbound00:10:152
991200992118,2cyclictest1121118-21kworker/u8:1+events_unbound22:47:292
991197992117,3cyclictest1173538-21kworker/u8:3+events_unbound22:15:241
991197992117,3cyclictest1173538-21kworker/u8:3+events_unbound00:00:211
991197992116,4cyclictest1272229-21apt-get23:45:101
991197992116,4cyclictest1173538-21kworker/u8:3+flush-259:023:25:001
991197992116,4cyclictest1064705-21kworker/u8:3+events_unbound21:25:171
991197992116,4cyclictest1064705-21kworker/u8:3+events_unbound21:25:171
991194992119,2cyclictest1105955-21kworker/u8:2+events_unbound21:13:560
991194992118,2cyclictest966025-21kworker/u8:1+events_unbound19:14:560
991194992118,2cyclictest1292696-21kworker/u8:2+events_unbound00:08:380
991194992118,2cyclictest1215028-21kworker/u8:2+events_unbound23:19:560
991194992118,2cyclictest1142664-21kworker/u8:0+events_unbound22:18:000
991194992117,3cyclictest1064705-21kworker/u8:3+events_unbound20:37:470
991194992117,3cyclictest1064705-21kworker/u8:3+events_unbound20:33:030
991205992013,5cyclictest1287491-21cp00:00:013
991200992017,2cyclictest1178494-21kworker/u8:4+events_unbound22:25:022
991200992016,3cyclictest1142664-21kworker/u8:0+events_unbound21:46:272
991200992014,2cyclictest1064705-21kworker/u8:3+events_unbound20:30:232
991197992017,2cyclictest1292696-21kworker/u8:2+events_unbound00:25:191
991197992016,3cyclictest500-21systemd-logind22:40:001
991197992016,3cyclictest1292696-21kworker/u8:2+events_unbound00:15:191
991197992016,3cyclictest1215028-21kworker/u8:2+events_unbound23:00:141
991197992016,3cyclictest1105955-21kworker/u8:2+flush-259:021:15:151
991197992016,3cyclictest1012644-21kworker/u8:1+flush-259:019:45:171
991194992017,2cyclictest1215028-21kworker/u8:2+events_unbound23:37:190
991194992017,2cyclictest1012644-21kworker/u8:1+events_unbound20:11:160
991194992016,3cyclictest1121118-21kworker/u8:1+events_unbound22:04:380
991205991915,3cyclictest1064705-21kworker/u8:3+flush-259:020:35:223
991205991912,5cyclictest335557-21systemd-journal22:03:253
991200991917,2cyclictest1012644-21kworker/u8:1+events_unbound20:10:222
991197991913,4cyclictest335557-21systemd-journal00:32:121
991194991916,2cyclictest996971-21kworker/u8:0+events_unbound19:20:060
991194991916,2cyclictest1215028-21kworker/u8:2+events_unbound23:13:030
991194991916,2cyclictest1204957-21kworker/u8:0+events_unbound22:41:590
991194991916,2cyclictest1173538-21kworker/u8:3+events_unbound23:48:040
991194991916,2cyclictest1121118-21kworker/u8:1+events_unbound21:43:180
991194991916,2cyclictest1064705-21kworker/u8:3+events_unbound21:09:580
991194991916,2cyclictest1012644-21kworker/u8:1+events_unbound20:23:320
991194991916,2cyclictest1012644-21kworker/u8:1+events_unbound20:04:560
991194991916,2cyclictest1007258-21idleruntime-cro19:30:000
991194991912,5cyclictest1090479-21latency_hist20:50:000
991205991815,2cyclictest1051411-21kthreadcore20:10:173
991205991814,3cyclictest1173538-21kworker/u8:3+flush-259:023:30:173
991205991814,3cyclictest1173538-21kworker/u8:3+flush-259:022:15:163
991200991815,2cyclictest1292696-21kworker/u8:2+events_unbound00:27:372
991200991815,2cyclictest1173538-21kworker/u8:3+events_unbound23:16:372
991200991814,3cyclictest985985-21kworker/u8:4+flush-259:019:55:302
991197991815,2cyclictest1173306-21sh22:10:001
991197991814,3cyclictest1215028-21kworker/u8:2+events_unbound23:15:141
991197991814,3cyclictest1064705-21kworker/u8:3+flush-259:020:25:201
99119499183,2cyclictest1048027-21ntpq20:05:210
991194991815,2cyclictest1292696-21kworker/u8:2+events_unbound00:17:140
991205991713,2cyclictest0-21swapper/300:30:013
991205991712,4cyclictest985985-21kworker/u8:4+flush-259:019:45:003
991205991712,4cyclictest1215028-21kworker/u8:2+flush-259:023:25:263
991205991712,4cyclictest1215028-21kworker/u8:2+flush-259:023:15:183
991205991712,3cyclictest335557-21systemd-journal00:07:353
991205991710,5cyclictest1132112-21latency_hist21:30:013
991205991710,5cyclictest1132112-21latency_hist21:30:003
991200991713,3cyclictest985984-21kworker/u8:2+events_unbound19:29:182
991200991713,3cyclictest1292696-21kworker/u8:2+events_unbound00:36:212
991200991712,4cyclictest1012644-21kworker/u8:1+flush-259:020:20:172
991197991714,2cyclictest1121118-21kworker/u8:1+flush-259:022:40:191
991197991711,4cyclictest335557-21systemd-journal19:19:171
991197991710,5cyclictest1146738-21ntpq21:40:211
991194991714,2cyclictest1173538-21kworker/u8:3+events_unbound22:47:180
991205991613,2cyclictest1189905-21irqcore22:25:183
991205991612,3cyclictest1173538-21kworker/u8:3+events_unbound23:35:173
991205991612,3cyclictest1105955-21kworker/u8:2+events_unbound21:30:183
991205991610,4cyclictest1012644-21kworker/u8:1+flush-259:019:45:053
991197991614,1cyclictest1064705-21kworker/u8:3+events_unbound20:40:221
991197991612,3cyclictest1064705-21kworker/u8:3+events_unbound20:45:221
99120599159,5cyclictest335557-21systemd-journal20:15:013
99120599159,4cyclictest335557-21systemd-journal22:12:213
991205991512,2cyclictest1168810-21irqcore22:05:163
991205991511,2cyclictest0-21swapper/322:45:173
991205991510,4cyclictest1173538-21kworker/u8:3+flush-259:023:00:253
991200991513,2cyclictest1142664-21kworker/u8:0+flush-259:022:20:212
99119799159,5cyclictest1058710-21ntpq20:15:231
991197991511,3cyclictest985984-21kworker/u8:2+flush-259:019:35:221
991197991510,3cyclictest1074980-21kworker/u8:0+flush-259:020:39:321
991197991510,3cyclictest1012644-21kworker/u8:1+flush-259:020:05:191
99120599149,3cyclictest985984-21kworker/u8:2+events_unbound19:30:173
991205991410,3cyclictest1282070-21kworker/u8:1+flush-259:000:33:203
991200991412,1cyclictest1313122-21ntp_kernel_err00:20:192
991197991410,3cyclictest985985-21kworker/u8:4+events_unbound19:20:241
991197991410,3cyclictest1173538-21kworker/u8:3+flush-259:022:30:261
99120599136,5cyclictest1002099-21cron19:25:003
991205991311,1cyclictest0-21swapper/320:45:003
991205991310,2cyclictest1225268-21idleruntime-cro22:59:593
99119799139,3cyclictest1173538-21kworker/u8:3+flush-259:022:55:311
99119799139,3cyclictest1163530-21fschecks_time22:00:151
99119799139,2cyclictest1012644-21kworker/u8:1+flush-259:020:00:161
991197991310,2cyclictest996971-21kworker/u8:0+events_unbound19:25:151
99120599129,2cyclictest1272295-21cpuspeed_turbos23:45:133
99120599129,2cyclictest0-21swapper/319:20:003
99120599127,3cyclictest985985-21kworker/u8:4+flush-259:019:50:243
99120599127,3cyclictest1325000-21latency_hist00:40:013
99120599125,5cyclictest335557-21systemd-journal21:20:013
99119799128,3cyclictest1121118-21kworker/u8:1+events_unbound21:55:221
99119799128,3cyclictest1105955-21kworker/u8:2+events_unbound21:35:261
99119799128,2cyclictest0-21swapper/100:20:121
99120599119,1cyclictest0-21swapper/323:05:123
99120599117,2cyclictest0-21swapper/321:40:193
99119799118,2cyclictest1215028-21kworker/u8:2+events_unbound23:40:161
99119799117,2cyclictest0-21swapper/123:30:181
99120599107,2cyclictest991127-21turbostat19:14:553
99119799104,4cyclictest1106148-21/usr/sbin/munin21:05:201
9912059996,1cyclictest0-21swapper/320:50:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional