You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 12:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Tue Jun 16, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24418222990,21sleep20-21swapper/219:05:232
33000721170,3sleep20-21swapper/223:10:112
29946421060,4sleep20-21swapper/221:40:182
24427927947,22sleep30-21swapper/319:05:253
139099780,66rtkit-daemon0-21swapper/119:08:051
24473826141,13sleep00-21swapper/019:08:230
2796742430,4sleep13056-21PK-Backend20:45:111
3008162370,2sleep00-21swapper/021:45:130
3482012360,2sleep00-21swapper/000:00:180
2672582340,3sleep3411rcuc/320:10:213
245002992818,6cyclictest275705-21idleruntime-cro20:35:001
139099280,20rtkit-daemon922-21systemd-logind21:46:351
3374032270,4chrt13-21ksoftirqd/023:30:180
24500999279,9cyclictest42-21ksoftirqd/300:38:373
245009992712,13cyclictest1-21systemd20:58:223
2984772260,13sleep013-21ksoftirqd/021:39:590
24499999254,2cyclictest13-21ksoftirqd/000:22:230
24500699240,22cyclictest1788620-21WebKitWebProces23:40:112
245002992414,7cyclictest436-20systemd-journal22:05:001
245002992414,7cyclictest1095-21runrttasks00:20:021
2907142230,8sleep0131ksoftirqd/021:15:220
245009992316,6cyclictest0-21swapper/322:09:193
245009992312,4cyclictest42-21ksoftirqd/300:20:463
139099230,15rtkit-daemon3056-21PK-Backend20:52:071
3483252220,8sleep2341ksoftirqd/200:00:212
2817002220,3sleep00-21swapper/020:50:160
245009992214,6cyclictest436-20systemd-journal23:34:593
245009992214,6cyclictest436-20systemd-journal21:15:003
245009992212,3cyclictest42-21ksoftirqd/322:20:483
245009992212,3cyclictest42-21ksoftirqd/321:46:243
24500999220,2cyclictest3056-21PK-Backend20:15:013
24500999220,20cyclictest3056-21PK-Backend21:44:453
245006992215,5cyclictest883-21dbus-daemon19:48:122
24500699220,3cyclictest295654-21df_inode21:30:132
245002992220,1cyclictest0-21swapper/123:00:161
245002992219,2cyclictest3056-21PK-Backend23:07:061
245002992215,5cyclictest272020-21mktemp20:25:001
244999992220,1cyclictest0-21swapper/000:16:080
244999992215,5cyclictest359476-21systemd-run00:34:590
244999992215,5cyclictest359476-21systemd-run00:34:590
139099220,15rtkit-daemon3056-21PK-Backend21:04:141
3048142210,3sleep03056-21PK-Backend21:55:200
245009992119,1cyclictest3056-21PK-Backend00:12:503
245009992119,1cyclictest3056-21PK-Backend00:02:553
245009992119,1cyclictest0-21swapper/323:41:543
245009992119,1cyclictest0-21swapper/322:55:103
245009992119,1cyclictest0-21swapper/322:53:203
245009992119,1cyclictest0-21swapper/322:48:073
245009992119,1cyclictest0-21swapper/321:27:093
245009992119,1cyclictest0-21swapper/320:53:363
245009992119,1cyclictest0-21swapper/320:45:313
245009992119,1cyclictest0-21swapper/320:30:313
245009992119,1cyclictest0-21swapper/319:38:053
245009992119,1cyclictest0-21swapper/319:16:363
245009992119,1cyclictest0-21swapper/319:12:173
245009992118,2cyclictest3056-21PK-Backend19:48:473
245009992117,3cyclictest42-21ksoftirqd/320:05:013
245009992114,5cyclictest328350-21tr23:05:133
245009992114,5cyclictest253473-21rt-features19:30:193
24500999210,3cyclictest3056-21PK-Backend22:30:023
24500999210,20cyclictest3056-21PK-Backend23:38:153
24500999210,19cyclictest3056-21PK-Backend21:35:193
24500999210,19cyclictest3056-21PK-Backend19:52:253
245006992117,2cyclictest248985-21cat19:20:012
245006992113,6cyclictest327230-21ntp_states23:00:192
24500699210,20cyclictest0-21swapper/222:25:292
245002992119,1cyclictest3056-21PK-Backend23:37:411
245002992119,1cyclictest3056-21PK-Backend21:24:041
245002992119,1cyclictest3056-21PK-Backend21:13:091
245002992119,1cyclictest3056-21PK-Backend20:44:091
245002992119,1cyclictest3056-21PK-Backend20:28:071
245002992119,1cyclictest3056-21PK-Backend19:44:471
245002992119,1cyclictest3056-21PK-Backend19:44:471
245002992119,1cyclictest3056-21PK-Backend19:23:181
245002992119,1cyclictest0-21swapper/123:57:421
245002992119,1cyclictest0-21swapper/122:22:581
245002992119,1cyclictest0-21swapper/121:57:491
245002992119,1cyclictest0-21swapper/121:53:311
245002992119,1cyclictest0-21swapper/100:10:261
245002992119,1cyclictest0-21swapper/100:04:581
24500299210,20cyclictest0-21swapper/123:33:151
24500299210,20cyclictest0-21swapper/123:19:551
24500299210,20cyclictest0-21swapper/122:38:471
24500299210,20cyclictest0-21swapper/100:30:271
24500299210,20cyclictest0-21swapper/100:30:271
24500299210,19cyclictest3056-21PK-Backend19:33:321
244999992119,1cyclictest0-21swapper/023:16:530
244999992119,1cyclictest0-21swapper/022:18:540
244999992119,1cyclictest0-21swapper/000:38:320
244999992113,6cyclictest298753-21apt21:40:110
24499999210,20cyclictest0-21swapper/023:49:040
24499999210,20cyclictest0-21swapper/022:11:580
24499999210,20cyclictest0-21swapper/021:12:020
24499999210,20cyclictest0-21swapper/019:51:520
24499999210,20cyclictest0-21swapper/019:26:230
24499999210,19cyclictest0-21swapper/023:10:180
139099210,15rtkit-daemon3056-21PK-Backend21:18:371
139099210,15rtkit-daemon3056-21PK-Backend19:18:401
139099210,15rtkit-daemon0-21swapper/120:05:441
139099210,14rtkit-daemon3056-21PK-Backend23:43:251
139099210,14rtkit-daemon0-21swapper/100:23:091
24500999207,3cyclictest42-21ksoftirqd/300:25:143
245009992018,1cyclictest3056-21PK-Backend22:28:403
245009992018,1cyclictest3056-21PK-Backend00:06:333
245009992018,1cyclictest0-21swapper/323:24:573
245009992018,1cyclictest0-21swapper/323:10:033
245009992018,1cyclictest0-21swapper/319:20:483
245009992017,2cyclictest3056-21PK-Backend22:37:043
245009992017,2cyclictest3056-21PK-Backend22:03:253
24500999201,17cyclictest272605-21df_inode20:25:133
245009992010,3cyclictest42-21ksoftirqd/319:57:293
24500999200,8cyclictest3056-21PK-Backend21:30:213
24500999200,19cyclictest3056-21PK-Backend00:19:053
24500999200,19cyclictest0-21swapper/323:18:423
24500999200,19cyclictest0-21swapper/322:13:043
24500999200,19cyclictest0-21swapper/321:19:453
24500999200,19cyclictest0-21swapper/320:24:023
24500999200,19cyclictest0-21swapper/319:29:133
245006992013,5cyclictest309746-21cat22:10:172
245006992012,6cyclictest346576-21ntpq23:55:192
24500699200,19cyclictest0-21swapper/223:46:122
24500699200,19cyclictest0-21swapper/221:59:202
24500699200,19cyclictest0-21swapper/221:37:092
24500699200,19cyclictest0-21swapper/221:21:072
24500699200,19cyclictest0-21swapper/220:57:082
24500699200,19cyclictest0-21swapper/220:35:312
245002992018,1cyclictest3056-21PK-Backend23:13:551
245002992018,1cyclictest3056-21PK-Backend22:11:021
245002992018,1cyclictest3056-21PK-Backend19:26:421
245002992018,1cyclictest0-21swapper/121:44:521
245002992018,1cyclictest0-21swapper/121:39:591
245002992018,1cyclictest0-21swapper/119:54:401
245002992018,1cyclictest0-21swapper/119:48:261
245002992018,1cyclictest0-21swapper/100:06:481
24500299200,1cyclictest0-21swapper/123:54:501
24500299200,1cyclictest0-21swapper/123:27:001
24500299200,19cyclictest3056-21PK-Backend23:49:241
24500299200,19cyclictest3056-21PK-Backend22:51:371
24500299200,19cyclictest3056-21PK-Backend21:28:021
24500299200,19cyclictest3056-21PK-Backend21:07:481
24500299200,19cyclictest0-21swapper/122:41:241
24500299200,18cyclictest3056-21PK-Backend20:10:361
24499999205,13cyclictest336652-21unin-run23:29:590
244999992018,1cyclictest3056-21PK-Backend20:17:470
244999992018,1cyclictest0-21swapper/020:39:300
244999992018,1cyclictest0-21swapper/019:46:240
244999992018,1cyclictest0-21swapper/019:15:490
244999992018,1cyclictest0-21swapper/000:29:400
244999992013,5cyclictest319421-21sed22:40:010
24499999200,1cyclictest3056-21PK-Backend21:20:200
24499999200,1cyclictest0-21swapper/023:39:240
24499999200,19cyclictest0-21swapper/021:30:120
24499999200,19cyclictest0-21swapper/000:07:020
24499999200,18cyclictest436-20systemd-journal20:11:220
245009991917,1cyclictest3056-21PK-Backend23:56:413
245009991917,1cyclictest3056-21PK-Backend21:51:153
245009991917,1cyclictest0-21swapper/323:46:343
245009991915,3cyclictest42-21ksoftirqd/320:40:003
245009991914,4cyclictest42-21ksoftirqd/321:09:593
24500999191,3cyclictest304813-21python321:55:203
245009991911,7cyclictest312381-21unin-run22:20:013
24500999191,16cyclictest256969-21python319:40:193
24500999191,16cyclictest256969-21python319:40:183
24500999190,7cyclictest292296-21ntp_states21:20:183
24500999190,1cyclictest3056-21PK-Backend22:42:053
24500999190,1cyclictest0-21swapper/323:01:113
24500999190,18cyclictest0-21swapper/320:41:533
24500999190,17cyclictest265661-21awk20:05:223
245006991917,1cyclictest3056-21PK-Backend22:37:322
245006991917,1cyclictest0-21swapper/220:28:282
245006991917,1cyclictest0-21swapper/220:24:162
245006991917,1cyclictest0-21swapper/219:38:332
245006991916,2cyclictest1095-21runrttasks20:52:002
245006991914,3cyclictest303674-21sh21:54:592
245006991912,5cyclictest280900-21/usr/sbin/munin20:50:002
245006991911,6cyclictest325143-21cat22:55:162
24500699190,1cyclictest338899-21apt23:35:122
24500699190,1cyclictest0-21swapper/222:20:072
24500699190,1cyclictest0-21swapper/221:15:122
24500699190,1cyclictest0-21swapper/220:41:462
24500699190,1cyclictest0-21swapper/220:31:052
24500699190,1cyclictest0-21swapper/220:18:272
24500699190,1cyclictest0-21swapper/219:10:552
24500699190,18cyclictest0-21swapper/223:53:032
24500699190,18cyclictest0-21swapper/221:29:252
24500699190,18cyclictest0-21swapper/221:12:152
24500699190,18cyclictest0-21swapper/219:20:492
24500699190,18cyclictest0-21swapper/200:09:052
24500299192,12cyclictest356244-21apt00:25:101
245002991917,1cyclictest3056-21PK-Backend23:21:451
245002991917,1cyclictest3056-21PK-Backend22:48:131
245002991917,1cyclictest3056-21PK-Backend20:01:441
245002991917,1cyclictest0-21swapper/119:59:541
245002991916,2cyclictest3056-21PK-Backend22:05:551
245002991916,2cyclictest3056-21PK-Backend00:35:541
24500299190,18cyclictest3056-21PK-Backend19:36:091
24500299190,18cyclictest0-21swapper/122:30:221
244999991917,1cyclictest0-21swapper/023:53:300
244999991916,2cyclictest3056-21PK-Backend20:56:070
24499999190,1cyclictest0-21swapper/021:52:310
24499999190,1cyclictest0-21swapper/021:28:380
24499999190,1cyclictest0-21swapper/000:10:410
24499999190,18cyclictest0-21swapper/022:01:090
245009991813,3cyclictest3594172chrt00:34:503
245009991813,3cyclictest3594172chrt00:34:493
245009991812,4cyclictest285291-21uname21:00:173
245009991811,5cyclictest345212-21seq23:50:443
24500999180,2cyclictest3056-21PK-Backend23:28:113
245006991816,1cyclictest0-21swapper/200:19:042
245006991816,1cyclictest0-21swapper/200:13:162
245006991811,5cyclictest308163-21ntpq22:05:202
245006991811,5cyclictest267087-21load20:10:182
245006991810,6cyclictest331826-21expr23:15:122
245006991810,6cyclictest256591-21cut19:40:142
245006991810,6cyclictest256591-21cut19:40:142
24500699180,1cyclictest0-21swapper/221:46:282
24500299182,11cyclictest268248-21apt20:15:121
245002991816,1cyclictest0-21swapper/120:35:371
245002991811,5cyclictest283367-21awk20:55:161
244999991816,1cyclictest0-21swapper/020:22:470
244999991816,1cyclictest0-21swapper/019:44:350
244999991816,1cyclictest0-21swapper/019:44:350
244999991816,1cyclictest0-21swapper/019:32:110
244999991813,4cyclictest317500-21sshd22:34:240
244999991813,3cyclictest315831-21turbostat22:30:000
244999991811,5cyclictest307522-21cat22:05:120
244999991811,5cyclictest285429-21cut21:00:180
24499999180,3cyclictest329697-21munin-run23:10:000
24499999180,17cyclictest0-21swapper/020:25:240
24500699179,6cyclictest436-20systemd-journal22:45:002
24500699179,6cyclictest321642-21expr22:45:122
245006991715,1cyclictest0-21swapper/220:00:442
245006991712,4cyclictest34-21ksoftirqd/222:50:112
245006991712,3cyclictest311293-21idleruntime22:15:152
245006991711,5cyclictest251814-21sed19:25:212
245006991711,4cyclictest287064-21ntpq21:05:182
245006991710,5cyclictest436-20systemd-journal23:25:002
245006991710,5cyclictest329675-21cron23:10:012
245006991710,5cyclictest316811-21ntpq22:30:182
245006991710,5cyclictest264999-21ls20:05:152
245002991715,1cyclictest3056-21PK-Backend19:14:391
245002991710,5cyclictest295953-21grep21:30:181
244999991715,1cyclictest3056-21PK-Backend22:43:550
244999991715,1cyclictest0-21swapper/023:43:030
244999991710,5cyclictest345825-21awk23:55:100
244999991710,5cyclictest325497-21cat22:55:200
24500699169,5cyclictest335423-21expr23:25:142
24500699169,5cyclictest0-21swapper/222:04:092
24500699168,6cyclictest883-21dbus-daemon19:33:112
245006991611,3cyclictest978-21snmpd21:03:312
245006991610,4cyclictest358932-21grep00:30:202
245006991610,4cyclictest358932-21grep00:30:202
245002991610,5cyclictest883-21dbus-daemon22:28:021
24499999168,6cyclictest333732-21expr23:20:120
244999991614,1cyclictest0-21swapper/021:09:040
244999991612,3cyclictest279605-21tr20:45:110
244999991612,3cyclictest255846-21latency_hist19:39:590
244999991610,4cyclictest1095-21runrttasks22:24:370
24499999160,1cyclictest0-21swapper/019:10:420
24500699159,4cyclictest357151-21wc00:25:202
24500699157,6cyclictest360107-21fw_packets00:35:162
24500699157,6cyclictest338357-21cron23:35:002
24500699151,12cyclictest1895009-21snapd19:54:132
245002991513,1cyclictest3056-21PK-Backend22:56:501
24499999159,4cyclictest274054-21date20:30:000
24499999158,6cyclictest327893-21sshd23:04:240
24499999157,6cyclictest883-21dbus-daemon19:25:010
244999991513,1cyclictest3056-21PK-Backend20:05:440
244999991511,2cyclictest262778-21sh20:00:000
244999991510,3cyclictest1095-21runrttasks20:03:390
24500699148,4cyclictest354690-21tr00:20:122
245006991412,1cyclictest0-21swapper/219:55:092
24499999143,10cyclictest324487-21grep22:55:000
24499999139,3cyclictest2174-21JS10:27:480
24499999137,4cyclictest278346-21tr20:40:180
139099120,4rtkit-daemon3056-21PK-Backend22:17:421
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional