You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 06:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Tue Jun 23, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1945127739,14sleep00-21swapper/019:07:160
1822027745,23sleep20-21swapper/219:05:132
139099720,58rtkit-daemon0-21swapper/119:05:151
1822227045,16sleep30-21swapper/319:05:143
629882450,5sleep13056-21PK-Backend21:10:141
312622400,3sleep13056-21PK-Backend19:40:121
1984099276,12cyclictest42-21ksoftirqd/319:45:013
139099270,4rtkit-daemon1389-21rtkit-daemon22:36:172
139099260,4rtkit-daemon1389-21rtkit-daemon23:18:392
139099260,4rtkit-daemon1389-21rtkit-daemon21:59:162
139099260,4rtkit-daemon1389-21rtkit-daemon21:08:012
139099250,4rtkit-daemon1389-21rtkit-daemon22:24:052
139099250,4rtkit-daemon1389-21rtkit-daemon22:01:342
139099250,4rtkit-daemon1389-21rtkit-daemon20:30:173
139099250,4rtkit-daemon1389-21rtkit-daemon00:26:402
19840992417,5cyclictest23682-21cron19:19:593
139099240,3rtkit-daemon1389-21rtkit-daemon21:01:293
485602230,4sleep13056-21PK-Backend20:30:011
19840992312,4cyclictest42-21ksoftirqd/322:10:503
1984099231,10cyclictest42-21ksoftirqd/319:30:113
1983799230,21cyclictest0-21swapper/219:15:032
139099230,4rtkit-daemon1389-21rtkit-daemon00:05:092
436622220,4sleep13056-21PK-Backend20:15:131
1984099229,5cyclictest42-21ksoftirqd/322:55:013
19840992220,1cyclictest3056-21PK-Backend22:21:273
19840992220,1cyclictest0-21swapper/323:09:393
19840992220,1cyclictest0-21swapper/323:09:393
19840992220,1cyclictest0-21swapper/323:00:073
19840992220,1cyclictest0-21swapper/321:30:243
19840992220,1cyclictest0-21swapper/320:51:163
19840992220,1cyclictest0-21swapper/320:29:333
19840992219,2cyclictest3056-21PK-Backend23:42:043
19840992217,3cyclictest66284-21cnf-update-db21:20:013
19840992214,6cyclictest53080-21python320:40:193
19840992212,3cyclictest42-21ksoftirqd/322:18:043
1984099220,2cyclictest3056-21PK-Backend23:55:013
19837992220,1cyclictest0-21swapper/223:40:472
19837992220,1cyclictest0-21swapper/223:11:412
19837992220,1cyclictest0-21swapper/222:31:332
1983799220,21cyclictest0-21swapper/223:58:462
1983799220,20cyclictest0-21swapper/200:17:522
1983499220,20cyclictest3056-21PK-Backend20:40:031
1983199229,2cyclictest141rcu_preempt20:05:130
19831992220,1cyclictest0-21swapper/023:52:480
19831992220,1cyclictest0-21swapper/023:13:000
19831992220,1cyclictest0-21swapper/022:16:070
19831992220,1cyclictest0-21swapper/020:39:280
19831992220,1cyclictest0-21swapper/019:20:320
19831992216,5cyclictest102728-21cron23:04:590
19831992215,5cyclictest134461-21cron00:35:000
1983199220,8cyclictest90608-21awk22:30:010
139099220,3rtkit-daemon1389-21rtkit-daemon19:37:242
139099220,18rtkit-daemon19825-21cyclictest00:32:362
139099220,18rtkit-daemon1009-21lldpd23:23:062
1984099215,14cyclictest61793-21cat21:05:233
19840992119,1cyclictest3056-21PK-Backend23:18:253
19840992119,1cyclictest3056-21PK-Backend22:46:483
19840992119,1cyclictest0-21swapper/320:55:223
19840992119,1cyclictest0-21swapper/320:49:133
19840992119,1cyclictest0-21swapper/319:20:383
19840992111,3cyclictest42-21ksoftirqd/300:25:353
19840992110,4cyclictest42-21ksoftirqd/323:20:523
19840992110,4cyclictest42-21ksoftirqd/321:50:493
1984099210,20cyclictest0-21swapper/323:14:463
1984099210,20cyclictest0-21swapper/321:28:003
1984099210,20cyclictest0-21swapper/321:15:563
1984099210,20cyclictest0-21swapper/320:01:493
19837992119,1cyclictest0-21swapper/223:26:492
19837992119,1cyclictest0-21swapper/223:07:572
19837992119,1cyclictest0-21swapper/223:07:562
19837992119,1cyclictest0-21swapper/223:01:002
19837992119,1cyclictest0-21swapper/222:45:252
19837992119,1cyclictest0-21swapper/221:37:392
19837992119,1cyclictest0-21swapper/220:53:452
19837992119,1cyclictest0-21swapper/220:32:432
19837992119,1cyclictest0-21swapper/220:14:382
19837992119,1cyclictest0-21swapper/220:14:382
19837992119,1cyclictest0-21swapper/219:43:222
19837992119,1cyclictest0-21swapper/219:20:512
19837992119,1cyclictest0-21swapper/200:04:412
1983799210,20cyclictest3056-21PK-Backend22:19:022
1983799210,20cyclictest0-21swapper/223:53:252
1983799210,20cyclictest0-21swapper/223:37:442
1983799210,20cyclictest0-21swapper/223:34:402
1983799210,20cyclictest0-21swapper/220:40:482
1983799210,20cyclictest0-21swapper/220:25:462
1983799210,20cyclictest0-21swapper/219:34:362
19834992119,1cyclictest3056-21PK-Backend19:38:521
19834992113,6cyclictest86534-21python322:15:211
19834992113,6cyclictest129989-21ntpq00:20:171
1983199217,2cyclictest141rcu_preempt22:00:190
19831992119,1cyclictest0-21swapper/023:58:410
19831992119,1cyclictest0-21swapper/023:43:140
19831992119,1cyclictest0-21swapper/023:39:350
19831992119,1cyclictest0-21swapper/023:32:530
19831992119,1cyclictest0-21swapper/022:33:580
19831992119,1cyclictest0-21swapper/022:12:150
19831992119,1cyclictest0-21swapper/021:57:220
19831992119,1cyclictest0-21swapper/021:21:260
19831992119,1cyclictest0-21swapper/021:06:450
19831992119,1cyclictest0-21swapper/020:53:210
19831992119,1cyclictest0-21swapper/020:31:450
19831992119,1cyclictest0-21swapper/020:29:490
19831992119,1cyclictest0-21swapper/020:12:440
19831992119,1cyclictest0-21swapper/020:12:440
19831992119,1cyclictest0-21swapper/019:57:100
19831992119,1cyclictest0-21swapper/019:34:530
19831992119,1cyclictest0-21swapper/000:39:040
19831992119,1cyclictest0-21swapper/000:23:370
19831992119,1cyclictest0-21swapper/000:16:270
19831992118,2cyclictest0-21swapper/021:47:280
19831992115,5cyclictest132467-21cron00:30:000
19831992113,6cyclictest883-21dbus-daemon23:30:000
1983199210,20cyclictest0-21swapper/023:48:350
1983199210,20cyclictest0-21swapper/020:16:570
1983199210,1cyclictest0-21swapper/021:30:460
139099210,3rtkit-daemon0-21swapper/119:10:371
1984099203,9cyclictest42-21ksoftirqd/320:15:013
1984099203,9cyclictest42-21ksoftirqd/320:15:003
19840992018,1cyclictest0-21swapper/323:35:353
19840992018,1cyclictest0-21swapper/321:38:283
19840992018,1cyclictest0-21swapper/321:11:243
1984099201,6cyclictest73262-21acpi21:40:093
19840992015,3cyclictest82438-21kernelversion22:05:183
1984099201,4cyclictest133873-21python300:30:213
19840992011,3cyclictest42-21ksoftirqd/320:00:013
19840992010,3cyclictest42-21ksoftirqd/322:25:223
1984099200,7cyclictest44030-21ntp_states20:15:173
1984099200,19cyclictest3056-21PK-Backend22:40:263
1984099200,19cyclictest3056-21PK-Backend22:39:513
1984099200,19cyclictest3056-21PK-Backend22:33:103
1984099200,19cyclictest0-21swapper/321:56:263
1984099200,18cyclictest3056-21PK-Backend00:10:163
19837992018,1cyclictest0-21swapper/222:57:142
19837992018,1cyclictest0-21swapper/221:03:042
19837992018,1cyclictest0-21swapper/220:23:162
19837992018,1cyclictest0-21swapper/200:36:032
19837992018,1cyclictest0-21swapper/200:11:162
19837992010,7cyclictest34091-21apt-get19:50:012
1983799200,1cyclictest0-21swapper/219:10:032
1983799200,19cyclictest3056-21PK-Backend21:41:312
1983799200,19cyclictest0-21swapper/222:52:552
1983799200,19cyclictest0-21swapper/221:29:002
1983799200,19cyclictest0-21swapper/220:17:432
19834992018,1cyclictest3056-21PK-Backend22:55:151
19834992016,2cyclictest109049-21load23:20:161
19834992012,6cyclictest87798-21fw_packets22:20:151
19834992012,6cyclictest75581-21memory21:45:141
19834992012,6cyclictest121780-21sshd23:56:331
19834992011,7cyclictest883-21dbus-daemon21:45:001
1983499200,1cyclictest3056-21PK-Backend21:26:551
1983499200,19cyclictest3056-21PK-Backend20:02:451
1983499200,19cyclictest3056-21PK-Backend00:27:421
1983499200,19cyclictest0-21swapper/100:18:161
1983499200,18cyclictest3056-21PK-Backend20:38:131
19831992019,1cyclictest0-21swapper/022:36:350
19831992018,1cyclictest3056-21PK-Backend19:10:330
19831992018,1cyclictest0-21swapper/023:16:040
19831992018,1cyclictest0-21swapper/022:40:200
19831992018,1cyclictest0-21swapper/020:20:020
19831992018,1cyclictest0-21swapper/019:40:280
19831992018,1cyclictest0-21swapper/019:28:450
19831992018,1cyclictest0-21swapper/000:07:060
19831992014,5cyclictest96999-21sed22:45:220
19831992013,6cyclictest123801-21cron00:04:590
1983199200,1cyclictest0-21swapper/021:38:500
1983199200,1cyclictest0-21swapper/019:36:290
1983199200,1cyclictest0-21swapper/019:19:110
1983199200,19cyclictest0-21swapper/021:42:410
1983199200,19cyclictest0-21swapper/020:55:240
1983199200,19cyclictest0-21swapper/020:40:560
1983199200,19cyclictest0-21swapper/000:11:470
1984099198,4cyclictest42-21ksoftirqd/300:15:383
1984099193,7cyclictest26353-21cut19:25:153
19840991917,1cyclictest3056-21PK-Backend21:49:493
19840991917,1cyclictest0-21swapper/322:59:333
19840991917,1cyclictest0-21swapper/322:01:133
19840991916,2cyclictest3056-21PK-Backend00:08:203
1984099190,7cyclictest347911cpuspeed_turbos19:50:123
1984099190,5cyclictest3056-21PK-Backend00:22:493
1984099190,2cyclictest30664-21systemd-run19:40:013
1984099190,1cyclictest0-21swapper/320:35:553
1984099190,1cyclictest0-21swapper/319:48:293
1984099190,1cyclictest0-21swapper/300:37:403
1984099190,18cyclictest0-21swapper/319:14:513
19837991917,1cyclictest0-21swapper/223:48:382
19837991917,1cyclictest0-21swapper/222:08:212
19837991917,1cyclictest0-21swapper/221:30:282
19837991917,1cyclictest0-21swapper/220:39:192
19837991913,5cyclictest34-21ksoftirqd/220:50:012
1983799190,1cyclictest0-21swapper/222:12:132
1983799190,1cyclictest0-21swapper/221:21:292
1983799190,1cyclictest0-21swapper/220:57:502
1983799190,18cyclictest0-21swapper/222:40:312
1983799190,18cyclictest0-21swapper/221:13:402
19834991917,1cyclictest3056-21PK-Backend21:34:511
19834991917,1cyclictest3056-21PK-Backend19:29:061
19834991917,1cyclictest0-21swapper/123:47:061
19834991917,1cyclictest0-21swapper/123:37:141
19834991917,1cyclictest0-21swapper/122:51:431
19834991917,1cyclictest0-21swapper/122:14:131
19834991912,5cyclictest91185-21cat22:30:121
19834991912,5cyclictest1095-21runrttasks22:35:171
19834991911,7cyclictest1-21systemd23:30:001
19834991911,6cyclictest97017-21threads22:45:221
1983499190,1cyclictest0-21swapper/121:51:491
1983499190,1cyclictest0-21swapper/100:14:251
1983499190,18cyclictest3056-21PK-Backend21:01:391
1983499190,18cyclictest3056-21PK-Backend20:32:181
1983499190,18cyclictest3056-21PK-Backend20:13:411
1983499190,18cyclictest3056-21PK-Backend20:13:401
1983499190,18cyclictest3056-21PK-Backend19:55:361
1983499190,18cyclictest0-21swapper/123:44:231
19831991917,1cyclictest0-21swapper/023:08:050
19831991917,1cyclictest0-21swapper/023:08:050
19831991917,1cyclictest0-21swapper/022:57:250
1984099189,4cyclictest42-21ksoftirqd/320:20:433
1984099180,6cyclictest3056-21PK-Backend23:30:133
1983799188,8cyclictest26610-21switchtime19:25:192
1983799182,12cyclictest34628-21apt19:50:122
19837991816,1cyclictest0-21swapper/219:59:302
1983799181,13cyclictest64346-21apt21:15:122
1983499183,2cyclictest141rcu_preempt20:46:461
19834991816,1cyclictest3056-21PK-Backend21:09:571
19834991816,1cyclictest3056-21PK-Backend20:52:071
19834991816,1cyclictest3056-21PK-Backend00:35:001
19834991816,1cyclictest0-21swapper/123:30:441
19834991816,1cyclictest0-21swapper/122:27:301
19834991815,2cyclictest3056-21PK-Backend22:00:541
1983499181,2cyclictest141rcu_preempt19:30:211
19834991811,5cyclictest436-20systemd-journal23:54:591
19834991811,5cyclictest124951-21swap00:05:211
1983499180,1cyclictest3056-21PK-Backend19:20:141
19831991816,1cyclictest0-21swapper/022:53:400
19831991816,1cyclictest0-21swapper/020:45:220
19831991815,2cyclictest3056-21PK-Backend21:54:590
19831991814,3cyclictest69541-21munin-plugin-st21:30:000
1984099178,2cyclictest141rcu_preempt00:04:463
19840991715,1cyclictest0-21swapper/320:09:263
1984099170,5cyclictest3056-21PK-Backend23:55:343
1984099170,5cyclictest3056-21PK-Backend23:45:183
1984099170,2cyclictest106304-21kworker/3:023:27:103
19837991715,1cyclictest0-21swapper/222:28:552
19837991715,1cyclictest0-21swapper/221:46:522
19837991712,4cyclictest978-21snmpd20:00:052
1983499172,2cyclictest141rcu_preempt20:55:151
19834991715,1cyclictest3056-21PK-Backend23:04:411
19834991715,1cyclictest3056-21PK-Backend21:23:501
1983499171,2cyclictest141rcu_preempt22:05:211
19834991711,5cyclictest94701-21cat22:40:131
19834991710,5cyclictest122634-21cat00:00:111
1983499170,15cyclictest3056-21PK-Backend19:50:291
1983499170,15cyclictest3056-21PK-Backend19:49:411
19831991715,1cyclictest0-21swapper/021:04:090
19831991712,3cyclictest64553-21cstates21:15:120
1983199171,14cyclictest883-21dbus-daemon22:10:000
19831991710,2cyclictest13-21ksoftirqd/019:55:000
1983799169,5cyclictest40020-21cstates20:05:132
1983799168,7cyclictest883-21dbus-daemon21:55:002
1983499168,2cyclictest141rcu_preempt21:35:151
19834991614,1cyclictest3056-21PK-Backend21:15:121
19834991612,3cyclictest108202-21latency_hist23:20:001
1983199163,11cyclictest63466-21rt-features21:10:210
19831991612,3cyclictest87616-21cstates22:20:120
19831991611,3cyclictest34098-21latency_hist19:50:000
19831991610,5cyclictest38184-21ls20:00:130
19837991513,1cyclictest0-21swapper/200:24:272
19834991513,1cyclictest3056-21PK-Backend21:58:111
19834991513,1cyclictest3056-21PK-Backend00:39:461
1983499150,1cyclictest3056-21PK-Backend20:07:041
1983199159,5cyclictest13-21ksoftirqd/023:20:100
1983499140,2cyclictest141rcu_preempt23:15:001
1983499140,2cyclictest141rcu_preempt23:05:131
1983499140,2cyclictest141rcu_preempt23:05:121
1983499140,2cyclictest141rcu_preempt19:20:001
1983499130,6cyclictest3056-21PK-Backend20:20:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional