You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 05:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Tue Jun 09, 2026 00:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
47428322900,8sleep20-21swapper/219:05:262
49409921300,3sleep20-21swapper/220:00:212
54962821170,3sleep33056-21PK-Backend22:40:183
50191221010,4sleep03056-21PK-Backend20:25:010
47339027946,23sleep00-21swapper/019:05:130
47453427338,9sleep30-21swapper/319:05:493
47459926142,14sleep10-21swapper/119:06:391
5578242420,3sleep1557829-21cpuspeed_turbos23:05:131
5444872380,5sleep20-21swapper/222:25:172
5429362380,3sleep00-21swapper/022:20:210
5276622340,11sleep013-21ksoftirqd/021:39:560
474988992815,4cyclictest13-21ksoftirqd/023:12:160
474988992711,3cyclictest13-21ksoftirqd/000:17:310
474988992610,4cyclictest13-21ksoftirqd/019:17:250
474988992512,3cyclictest13-21ksoftirqd/021:43:300
474988992510,4cyclictest13-21ksoftirqd/023:18:280
139099250,3rtkit-daemon0-21swapper/120:12:091
474988992413,3cyclictest13-21ksoftirqd/019:28:560
474988992412,3cyclictest13-21ksoftirqd/019:50:000
474988992410,3cyclictest13-21ksoftirqd/021:10:010
139099240,3rtkit-daemon1389-21rtkit-daemon19:13:292
47499499232,3cyclictest141rcu_preempt21:15:002
474988992310,4cyclictest13-21ksoftirqd/021:11:420
474988992310,4cyclictest13-21ksoftirqd/019:53:020
474988992310,4cyclictest13-21ksoftirqd/019:53:020
474988992310,4cyclictest13-21ksoftirqd/019:13:440
5586342220,4sleep20-21swapper/223:05:232
5465092220,3sleep1251rcuc/122:30:211
474995992220,1cyclictest0-21swapper/320:46:313
474995992220,1cyclictest0-21swapper/320:01:293
474995992219,2cyclictest3056-21PK-Backend20:33:593
47499599220,20cyclictest3056-21PK-Backend21:27:533
47499599220,20cyclictest3056-21PK-Backend20:16:093
474994992214,6cyclictest34-21ksoftirqd/223:00:212
474990992214,6cyclictest436-20systemd-journal00:30:011
47499099220,3cyclictest542556-21irqstats22:20:181
47499099220,21cyclictest0-21swapper/122:46:541
47498899229,3cyclictest13-21ksoftirqd/022:46:150
47498899229,3cyclictest13-21ksoftirqd/022:01:380
47498899228,4cyclictest13-21ksoftirqd/020:16:430
47498899226,4cyclictest13-21ksoftirqd/023:30:140
47498899224,4cyclictest13-21ksoftirqd/023:55:150
474988992220,1cyclictest0-21swapper/023:45:410
474988992213,7cyclictest585458-21cron00:25:000
474988992211,3cyclictest13-21ksoftirqd/020:49:360
47498899220,2cyclictest588027-21sed00:30:170
47498899220,11cyclictest13-21ksoftirqd/021:45:120
474995992119,1cyclictest3056-21PK-Backend22:45:073
474995992119,1cyclictest3056-21PK-Backend21:50:463
474995992119,1cyclictest3056-21PK-Backend19:35:203
474995992119,1cyclictest3056-21PK-Backend00:10:183
474995992119,1cyclictest0-21swapper/323:52:593
474995992119,1cyclictest0-21swapper/322:01:003
474995992119,1cyclictest0-21swapper/321:00:293
474995992119,1cyclictest0-21swapper/320:42:323
474995992119,1cyclictest0-21swapper/319:52:573
474995992119,1cyclictest0-21swapper/319:52:573
474995992119,1cyclictest0-21swapper/300:20:313
474995992118,2cyclictest3056-21PK-Backend21:35:593
474995992113,6cyclictest436-20systemd-journal00:17:003
47499599210,20cyclictest3056-21PK-Backend21:33:013
47499599210,20cyclictest0-21swapper/319:12:213
47499599210,1cyclictest3056-21PK-Backend19:41:003
47499599210,19cyclictest3056-21PK-Backend23:30:093
47499599210,19cyclictest3056-21PK-Backend22:52:023
47499599210,19cyclictest3056-21PK-Backend20:06:213
474994992119,1cyclictest0-21swapper/221:22:532
474994992113,2cyclictest34-21ksoftirqd/220:45:202
47499499210,20cyclictest0-21swapper/222:47:152
474990992118,2cyclictest3056-21PK-Backend22:00:441
474990992113,6cyclictest494664-21sed20:05:011
474990992113,6cyclictest436-20systemd-journal23:55:001
47499099210,20cyclictest3056-21PK-Backend00:16:031
47499099210,20cyclictest0-21swapper/123:16:351
47499099210,20cyclictest0-21swapper/121:51:041
47499099210,20cyclictest0-21swapper/120:40:341
47499099210,19cyclictest580001-21apt-get00:10:011
47498899215,4cyclictest13-21ksoftirqd/000:35:160
47498899212,15cyclictest494764-21apt20:05:150
474988992119,1cyclictest0-21swapper/020:33:240
474988992116,3cyclictest573769-21/usr/sbin/munin23:50:140
47498899210,20cyclictest0-21swapper/022:40:190
474995992018,1cyclictest3056-21PK-Backend22:06:553
474995992018,1cyclictest3056-21PK-Backend21:41:543
474995992018,1cyclictest3056-21PK-Backend21:19:163
474995992018,1cyclictest3056-21PK-Backend20:35:363
474995992018,1cyclictest3056-21PK-Backend19:34:183
474995992018,1cyclictest0-21swapper/323:15:563
474995992018,1cyclictest0-21swapper/321:05:573
474995992017,2cyclictest3056-21PK-Backend23:24:203
474995992017,2cyclictest3056-21PK-Backend22:35:483
474995992017,2cyclictest3056-21PK-Backend22:13:373
474995992017,2cyclictest3056-21PK-Backend00:00:513
47499599201,16cyclictest501958-21apt20:25:113
47499599200,1cyclictest3056-21PK-Backend23:42:463
47499599200,1cyclictest3056-21PK-Backend00:28:213
47499599200,19cyclictest0-21swapper/321:12:133
47499599200,19cyclictest0-21swapper/319:28:373
474994992018,1cyclictest0-21swapper/223:44:202
474994992018,1cyclictest0-21swapper/221:57:272
474994992018,1cyclictest0-21swapper/219:56:412
474994992018,1cyclictest0-21swapper/219:49:582
474994992018,1cyclictest0-21swapper/200:38:152
474994992018,1cyclictest0-21swapper/200:34:222
474994992018,1cyclictest0-21swapper/200:09:552
474994992017,2cyclictest0-21swapper/223:15:482
474994992012,6cyclictest582992-21awk00:15:202
474994992012,6cyclictest574065-21ntpq23:50:182
474994992012,6cyclictest496221-21apt-get20:10:002
474994992012,6cyclictest436-20systemd-journal19:17:002
474994992012,6cyclictest34-21ksoftirqd/223:35:162
474994992012,2cyclictest34-21ksoftirqd/222:10:172
47499499200,19cyclictest3056-21PK-Backend21:19:552
47499499200,19cyclictest0-21swapper/223:55:502
47499499200,19cyclictest0-21swapper/223:28:392
47499499200,19cyclictest0-21swapper/222:36:072
47499499200,19cyclictest0-21swapper/222:21:472
47499499200,19cyclictest0-21swapper/222:05:452
47499499200,19cyclictest0-21swapper/221:32:332
47499499200,19cyclictest0-21swapper/221:00:422
47499499200,19cyclictest0-21swapper/220:32:572
47499499200,19cyclictest0-21swapper/220:20:542
47499499200,19cyclictest0-21swapper/220:15:402
47499499200,19cyclictest0-21swapper/220:10:332
47499499200,19cyclictest0-21swapper/219:25:592
474990992018,1cyclictest0-21swapper/123:43:521
474990992018,1cyclictest0-21swapper/123:31:021
474990992018,1cyclictest0-21swapper/123:27:371
474990992018,1cyclictest0-21swapper/122:16:331
474990992018,1cyclictest0-21swapper/121:08:321
474990992017,2cyclictest3056-21PK-Backend21:30:571
47499099200,1cyclictest0-21swapper/123:59:341
47499099200,1cyclictest0-21swapper/100:23:411
47499099200,19cyclictest3056-21PK-Backend20:28:171
47499099200,19cyclictest3056-21PK-Backend20:22:211
47499099200,19cyclictest3056-21PK-Backend19:18:141
47499099200,19cyclictest3056-21PK-Backend19:13:071
47499099200,19cyclictest0-21swapper/121:45:091
47499099200,19cyclictest0-21swapper/119:43:021
47499099200,19cyclictest0-21swapper/119:26:461
47499099200,19cyclictest0-21swapper/100:04:481
47498899209,4cyclictest13-21ksoftirqd/020:38:530
47498899209,4cyclictest13-21ksoftirqd/020:26:100
47498899208,4cyclictest13-21ksoftirqd/023:08:190
47498899208,4cyclictest13-21ksoftirqd/022:35:500
47498899202,15cyclictest513804-21cron20:59:590
474988992018,1cyclictest0-21swapper/022:09:500
474988992018,1cyclictest0-21swapper/021:19:210
474988992018,1cyclictest0-21swapper/019:56:470
474988992011,2cyclictest141rcu_preempt23:20:020
47498899200,9cyclictest13-21ksoftirqd/022:50:190
47498899200,10cyclictest13-21ksoftirqd/021:50:120
139099200,14rtkit-daemon3056-21PK-Backend23:12:291
139099200,14rtkit-daemon0-21swapper/123:46:011
139099200,14rtkit-daemon0-21swapper/123:04:221
139099200,14rtkit-daemon0-21swapper/023:27:040
139099200,13rtkit-daemon0-21swapper/122:38:371
139099200,13rtkit-daemon0-21swapper/121:20:251
4828972190,3sleep13056-21PK-Backend19:30:121
474995991917,1cyclictest3056-21PK-Backend22:27:153
474995991917,1cyclictest3056-21PK-Backend19:22:013
474995991917,1cyclictest0-21swapper/322:17:223
474995991917,1cyclictest0-21swapper/320:21:573
474995991917,1cyclictest0-21swapper/300:06:533
474995991916,2cyclictest3056-21PK-Backend21:58:013
474995991916,2cyclictest3056-21PK-Backend00:38:433
474995991914,3cyclictest978-21snmpd22:20:113
474995991914,3cyclictest565004-21hddtemp_smartct23:25:153
474995991912,5cyclictest477329-21cat19:15:033
47499599190,1cyclictest3056-21PK-Backend21:45:393
47499599190,18cyclictest3056-21PK-Backend20:11:163
474994991917,1cyclictest0-21swapper/223:46:102
474994991917,1cyclictest0-21swapper/222:04:562
474994991917,1cyclictest0-21swapper/221:41:392
474994991913,2cyclictest34-21ksoftirqd/221:45:202
474994991912,5cyclictest490534-21cat19:50:212
474994991912,5cyclictest490534-21cat19:50:202
474994991911,2cyclictest34-21ksoftirqd/221:50:192
47499499190,18cyclictest0-21swapper/223:31:152
47499499190,18cyclictest0-21swapper/222:40:062
47499499190,18cyclictest0-21swapper/222:30:312
47499499190,18cyclictest0-21swapper/222:16:262
47499499190,18cyclictest0-21swapper/200:29:292
47499499190,18cyclictest0-21swapper/200:23:002
47499499190,17cyclictest34-21ksoftirqd/221:05:182
474990991917,1cyclictest0-21swapper/123:37:031
474990991917,1cyclictest0-21swapper/122:50:531
474990991917,1cyclictest0-21swapper/122:11:591
474990991917,1cyclictest0-21swapper/120:50:551
474990991917,1cyclictest0-21swapper/120:32:501
474990991917,1cyclictest0-21swapper/119:38:081
474990991916,2cyclictest0-21swapper/120:45:211
474990991913,5cyclictest563894-21sed23:20:221
474990991913,5cyclictest494999-21ls20:05:161
474990991912,5cyclictest524399-21cut21:30:011
474990991911,6cyclictest578541-21apt00:05:131
474990991911,6cyclictest554952-21ntp_states22:55:191
47499099190,1cyclictest0-21swapper/122:28:491
47499099190,1cyclictest0-21swapper/121:17:441
47499099190,1cyclictest0-21swapper/119:45:521
47499099190,1cyclictest0-21swapper/100:39:421
47499099190,1cyclictest0-21swapper/100:31:111
47499099190,18cyclictest3056-21PK-Backend19:52:211
47499099190,18cyclictest3056-21PK-Backend19:52:211
47499099190,18cyclictest0-21swapper/122:43:421
47499099190,18cyclictest0-21swapper/120:16:481
47499099190,18cyclictest0-21swapper/119:21:591
47498899198,3cyclictest13-21ksoftirqd/019:20:330
47498899196,3cyclictest13-21ksoftirqd/023:41:090
47498899195,2cyclictest141rcu_preempt00:00:170
474988991917,1cyclictest0-21swapper/020:01:480
474988991915,3cyclictest13-21ksoftirqd/022:15:010
474988991914,4cyclictest13-21ksoftirqd/023:05:010
474988991913,5cyclictest13-21ksoftirqd/000:10:010
474988991911,5cyclictest913-21gdbus20:15:010
139099190,14rtkit-daemon0-21swapper/022:57:240
139099190,13rtkit-daemon0-21swapper/021:28:120
47499599184,13cyclictest588468-21timerandwakeup00:30:223
474995991816,1cyclictest3056-21PK-Backend23:58:133
474995991816,1cyclictest0-21swapper/323:38:343
474995991815,2cyclictest3056-21PK-Backend23:45:233
474995991815,2cyclictest3056-21PK-Backend22:34:123
474995991815,2cyclictest3056-21PK-Backend20:55:503
474995991810,6cyclictest560148-21ntpq23:10:193
47499599180,17cyclictest0-21swapper/319:45:403
474994991816,1cyclictest0-21swapper/220:36:082
474994991816,1cyclictest0-21swapper/219:34:302
474994991816,1cyclictest0-21swapper/200:02:042
474994991815,2cyclictest0-21swapper/200:11:452
474994991813,3cyclictest512079-21sh20:55:002
474994991811,5cyclictest563369-21sed23:20:172
474994991810,6cyclictest560153-21ntpq23:10:192
474990991816,1cyclictest0-21swapper/120:39:461
474990991812,5cyclictest517513-21date21:10:011
474990991811,6cyclictest513374-21sed20:55:211
474990991811,5cyclictest533893-21ntp_states21:55:181
474990991811,5cyclictest526582-21df21:35:131
47498899187,3cyclictest13-21ksoftirqd/021:22:190
474988991813,4cyclictest13-21ksoftirqd/023:35:140
474988991813,3cyclictest13-21ksoftirqd/022:35:010
474988991812,5cyclictest484123-21systemd-run19:35:010
474988991812,4cyclictest13-21ksoftirqd/020:45:000
474988991811,4cyclictest1095-21runrttasks22:25:210
47498899181,12cyclictest524487-21apt21:30:120
474995991715,1cyclictest3056-21PK-Backend22:55:133
474995991715,1cyclictest0-21swapper/321:20:043
474994991715,1cyclictest0-21swapper/221:37:052
474994991715,1cyclictest0-21swapper/221:26:382
474994991710,6cyclictest554935-21awk22:55:182
474990991715,1cyclictest3056-21PK-Backend21:44:211
474990991712,3cyclictest536872-21apt22:05:101
47498899178,3cyclictest13-21ksoftirqd/021:55:240
47498899177,6cyclictest484342-21/usr/sbin/munin19:35:100
474988991712,4cyclictest13-21ksoftirqd/020:55:000
474988991712,4cyclictest13-21ksoftirqd/019:45:000
474988991710,5cyclictest586477-21ntpq00:25:190
474995991614,1cyclictest3056-21PK-Backend23:00:493
474995991614,1cyclictest3056-21PK-Backend19:58:383
474994991614,1cyclictest0-21swapper/219:42:282
474994991614,1cyclictest0-21swapper/219:23:352
474994991612,2cyclictest34-21ksoftirqd/222:50:182
474994991611,3cyclictest507909-21open_files20:40:192
474994991611,3cyclictest5027282sleep220:25:202
474990991614,1cyclictest0-21swapper/121:00:551
474990991614,1cyclictest0-21swapper/119:56:131
47498899168,6cyclictest514480-21sshd21:00:150
47498899162,9cyclictest580532-21apt00:10:110
474988991610,4cyclictest540780-21cat22:15:130
47499599158,5cyclictest510786-21grep20:50:123
474994991512,2cyclictest3056-21PK-Backend20:55:152
474994991510,3cyclictest2156-21gnome-shell19:35:092
47499599149,4cyclictest42-21ksoftirqd/323:07:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional