You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 14:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat Sep 05, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
411637021110,4sleep00-21swapper/020:45:180
414598221090,4sleep03056-21PK-Backend22:10:200
413194921030,3sleep30-21swapper/321:30:183
408533921000,3sleep20-21swapper/219:20:042
41544372970,3sleep30-21swapper/322:35:133
408051427639,32sleep20-21swapper/219:06:092
407933727252,13sleep10-21swapper/119:05:071
408047026546,13sleep00-21swapper/019:05:340
408072026341,14sleep30-21swapper/319:08:463
41363842520,3sleep30-21swapper/321:45:003
41789162460,4sleep13056-21PK-Backend23:45:161
41677252370,2sleep13056-21PK-Backend23:15:011
41131932360,1chrt4112135-21/usr/sbin/munin20:35:211
41793922280,5sleep20-21swapper/223:45:222
40896332270,13sleep2331rcuc/219:30:182
4080958992614,10cyclictest4104348-21python320:10:233
4080956992615,8cyclictest886-21NetworkManager21:59:052
408095099266,4cyclictest13-21ksoftirqd/020:14:290
41650242250,2sleep30-21swapper/323:05:163
4080950992420,3cyclictest161rcuc/000:00:060
4080950992417,2cyclictest141rcu_preempt19:19:370
408095099241,21cyclictest4148590-21idleruntime-cro22:19:590
408095099236,4cyclictest13-21ksoftirqd/020:45:010
408095099234,10cyclictest13-21ksoftirqd/023:07:520
139099230,15rtkit-daemon3056-21PK-Backend21:25:152
139099230,15rtkit-daemon3056-21PK-Backend21:25:152
41267912220,3chrt0-21swapper/021:15:180
41051962220,2sleep20-21swapper/220:15:102
40975362220,2sleep20-21swapper/219:55:012
4080956992213,7cyclictest436-20systemd-journal00:40:002
4080956992213,7cyclictest4189181-21cat00:15:182
4080956992213,7cyclictest4189181-21cat00:15:182
408095199220,20cyclictest26-21ksoftirqd/122:30:361
408095099224,10cyclictest13-21ksoftirqd/023:24:070
4080950992220,1cyclictest0-21swapper/021:57:020
4080950992220,1cyclictest0-21swapper/020:56:590
4080950992220,1cyclictest0-21swapper/020:27:040
4080950992220,1cyclictest0-21swapper/020:27:040
4080950992220,1cyclictest0-21swapper/000:22:410
4080950992219,2cyclictest0-21swapper/022:01:270
4080950992217,3cyclictest13-21ksoftirqd/000:00:000
4080950992211,4cyclictest13-21ksoftirqd/000:19:530
4080950992211,4cyclictest13-21ksoftirqd/000:19:530
408095099220,9cyclictest3056-21PK-Backend22:09:440
408095099220,21cyclictest0-21swapper/020:35:230
139099220,15rtkit-daemon3056-21PK-Backend00:05:083
139099220,14rtkit-daemon3056-21PK-Backend21:22:363
408095899216,13cyclictest4171457-21cpuspeed23:25:133
408095899216,13cyclictest4171457-21cpuspeed23:25:133
4080958992119,1cyclictest3056-21PK-Backend22:50:143
4080958992119,1cyclictest3056-21PK-Backend19:36:413
4080958992116,3cyclictest4192179-21perf00:24:593
4080958992113,6cyclictest4168262-21expr23:15:123
408095899210,20cyclictest0-21swapper/322:57:373
408095899210,19cyclictest3056-21PK-Backend19:23:443
4080956992119,1cyclictest0-21swapper/200:04:262
4080956992114,5cyclictest883-21dbus-daemon20:15:002
4080956992113,6cyclictest883-21dbus-daemon20:54:052
408095699210,20cyclictest0-21swapper/223:10:452
408095199215,14cyclictest1-21systemd21:25:011
4080951992119,1cyclictest3056-21PK-Backend23:38:151
4080951992119,1cyclictest3056-21PK-Backend23:16:391
4080951992119,1cyclictest3056-21PK-Backend22:23:261
4080951992119,1cyclictest3056-21PK-Backend21:57:571
4080951992119,1cyclictest3056-21PK-Backend19:31:101
4080951992119,1cyclictest0-21swapper/123:25:251
4080951992119,1cyclictest0-21swapper/123:25:251
4080951992119,1cyclictest0-21swapper/119:35:291
4080951992119,1cyclictest0-21swapper/100:35:201
4080951992118,2cyclictest3056-21PK-Backend22:26:431
4080951992118,2cyclictest3056-21PK-Backend22:26:431
4080951992118,2cyclictest3056-21PK-Backend19:46:441
408095199210,20cyclictest0-21swapper/123:43:081
408095199210,20cyclictest0-21swapper/121:12:011
408095199210,1cyclictest3056-21PK-Backend19:29:001
408095199210,19cyclictest0-21swapper/122:45:091
4080950992119,1cyclictest3056-21PK-Backend19:45:210
4080950992119,1cyclictest0-21swapper/023:48:410
4080950992119,1cyclictest0-21swapper/023:42:130
4080950992119,1cyclictest0-21swapper/021:36:190
4080950992119,1cyclictest0-21swapper/020:31:310
4080950992119,1cyclictest0-21swapper/020:16:100
4080950992119,1cyclictest0-21swapper/020:09:410
4080950992119,1cyclictest0-21swapper/019:42:580
4080950992119,1cyclictest0-21swapper/019:35:270
4080950992119,1cyclictest0-21swapper/019:20:320
408095099211,4cyclictest13-21ksoftirqd/022:55:480
408095099210,20cyclictest3056-21PK-Backend23:26:580
408095099210,20cyclictest3056-21PK-Backend23:26:580
408095099210,20cyclictest3056-21PK-Backend23:15:160
408095099210,20cyclictest0-21swapper/023:54:220
408095099210,20cyclictest0-21swapper/022:39:470
408095099210,20cyclictest0-21swapper/022:33:110
139099210,14rtkit-daemon3056-21PK-Backend22:19:303
139099210,14rtkit-daemon3056-21PK-Backend20:33:403
139099210,14rtkit-daemon0-21swapper/223:56:142
139099210,13rtkit-daemon3056-21PK-Backend00:05:142
41484262200,12sleep20-21swapper/222:18:162
4080958992018,1cyclictest0-21swapper/323:48:143
4080958992018,1cyclictest0-21swapper/300:38:023
4080958992017,2cyclictest3056-21PK-Backend23:51:103
4080958992017,2cyclictest3056-21PK-Backend19:19:043
4080958992017,2cyclictest3056-21PK-Backend00:02:323
408095899201,6cyclictest4102352-21python320:05:203
4080958992013,5cyclictest4189095-21diskstats00:15:163
4080958992013,5cyclictest4189095-21diskstats00:15:153
408095899201,12cyclictest41700372hddtemp_smartct23:20:153
408095899200,8cyclictest4120203-21seq20:55:333
408095899200,1cyclictest3056-21PK-Backend21:15:233
408095899200,1cyclictest0-21swapper/321:50:253
408095899200,19cyclictest3056-21PK-Backend22:40:553
408095899200,19cyclictest3056-21PK-Backend22:07:003
408095899200,19cyclictest3056-21PK-Backend20:50:563
408095899200,19cyclictest3056-21PK-Backend20:41:373
408095899200,19cyclictest3056-21PK-Backend19:52:423
408095899200,19cyclictest0-21swapper/322:10:523
408095899200,19cyclictest0-21swapper/321:49:023
408095899200,19cyclictest0-21swapper/319:48:583
408095899200,18cyclictest3056-21PK-Backend22:47:303
408095899200,18cyclictest3056-21PK-Backend22:20:333
4080956992018,1cyclictest0-21swapper/222:22:392
4080956992018,1cyclictest0-21swapper/222:06:242
4080956992018,1cyclictest0-21swapper/222:00:022
4080956992018,1cyclictest0-21swapper/221:23:312
4080956992018,1cyclictest0-21swapper/220:30:452
4080956992018,1cyclictest0-21swapper/220:04:292
4080956992018,1cyclictest0-21swapper/200:25:552
4080956992012,6cyclictest4192167-21cron00:24:592
408095699200,9cyclictest4107623-21grep20:20:182
408095699200,19cyclictest3056-21PK-Backend23:51:292
408095699200,19cyclictest0-21swapper/223:35:462
408095699200,19cyclictest0-21swapper/223:30:532
408095699200,19cyclictest0-21swapper/222:47:202
408095699200,19cyclictest0-21swapper/222:41:182
408095699200,19cyclictest0-21swapper/221:43:462
408095699200,19cyclictest0-21swapper/221:16:492
408095699200,19cyclictest0-21swapper/220:39:522
408095699200,19cyclictest0-21swapper/220:29:242
408095699200,19cyclictest0-21swapper/220:29:242
408095699200,19cyclictest0-21swapper/219:44:432
408095699200,19cyclictest0-21swapper/219:27:332
408095699200,19cyclictest0-21swapper/219:18:342
4080951992018,1cyclictest0-21swapper/122:43:471
4080951992018,1cyclictest0-21swapper/119:19:261
4080951992018,1cyclictest0-21swapper/100:05:051
4080951992014,4cyclictest4146583-21latency_hist22:15:011
4080951992014,4cyclictest4127487-21cron21:20:001
4080951992013,5cyclictest4188105-21taskset00:10:461
4080951992013,5cyclictest4122905-21cat21:05:121
408095199201,16cyclictest2156-21gnome-shell21:30:081
408095199200,1cyclictest3056-21PK-Backend21:37:091
408095199200,1cyclictest0-21swapper/122:54:281
408095199200,19cyclictest0-21swapper/122:03:321
408095199200,19cyclictest0-21swapper/119:12:511
408095199200,19cyclictest0-21swapper/100:00:471
408095099207,4cyclictest13-21ksoftirqd/023:14:130
408095099203,15cyclictest1715-21apt-get00:35:010
4080950992018,1cyclictest3056-21PK-Backend22:23:180
4080950992018,1cyclictest0-21swapper/022:29:540
4080950992018,1cyclictest0-21swapper/022:29:530
4080950992018,1cyclictest0-21swapper/021:31:200
4080950992018,1cyclictest0-21swapper/020:02:240
4080950992018,1cyclictest0-21swapper/019:58:110
4080950992018,1cyclictest0-21swapper/019:10:330
4080950992018,1cyclictest0-21swapper/000:36:210
4080950992017,2cyclictest3056-21PK-Backend19:30:200
4080950992016,2cyclictest4185254-21apt00:05:110
4080950992013,5cyclictest4156642-21seq22:40:200
4080950992012,6cyclictest4158248-21ntp_states22:45:190
4080950992010,3cyclictest13-21ksoftirqd/021:23:010
408095099200,19cyclictest0-21swapper/022:54:330
408095099200,19cyclictest0-21swapper/021:29:240
408095099200,19cyclictest0-21swapper/021:29:240
408095099200,19cyclictest0-21swapper/019:51:420
139099200,14rtkit-daemon3056-21PK-Backend21:08:483
139099200,13rtkit-daemon3056-21PK-Backend19:11:043
139099200,13rtkit-daemon0-21swapper/319:56:433
41375642190,11sleep20-21swapper/221:45:562
4080958991917,1cyclictest3056-21PK-Backend20:49:343
4080958991917,1cyclictest0-21swapper/321:37:263
4080958991917,1cyclictest0-21swapper/319:27:143
4080958991917,1cyclictest0-21swapper/300:11:463
4080958991913,5cyclictest4175290-21if_err_enp2s023:35:153
4080958991911,6cyclictest436-20systemd-journal23:45:013
408095899190,1cyclictest3056-21PK-Backend23:32:453
408095899190,1cyclictest3056-21PK-Backend22:34:183
408095899190,1cyclictest3056-21PK-Backend21:27:273
408095899190,1cyclictest3056-21PK-Backend21:27:273
408095899190,1cyclictest3056-21PK-Backend21:02:403
408095899190,1cyclictest3056-21PK-Backend19:40:273
408095899190,1cyclictest0-21swapper/323:12:043
408095899190,1cyclictest0-21swapper/323:04:263
408095899190,18cyclictest3056-21PK-Backend22:02:353
408095899190,18cyclictest0-21swapper/320:00:203
408095899190,18cyclictest0-21swapper/300:29:433
4080956991917,1cyclictest0-21swapper/223:44:592
4080956991917,1cyclictest0-21swapper/223:15:392
4080956991917,1cyclictest0-21swapper/223:01:472
4080956991917,1cyclictest0-21swapper/222:27:202
4080956991917,1cyclictest0-21swapper/222:27:202
4080956991917,1cyclictest0-21swapper/222:10:162
4080956991917,1cyclictest0-21swapper/221:32:582
4080956991917,1cyclictest0-21swapper/220:45:192
4080956991917,1cyclictest0-21swapper/219:11:302
4080956991913,4cyclictest978-21snmpd19:46:592
4080956991913,4cyclictest4188263-21sshd00:12:492
4080956991911,6cyclictest2267-21packagekitd19:35:022
408095699190,1cyclictest0-21swapper/221:37:242
408095699190,1cyclictest0-21swapper/220:41:142
4080951991917,1cyclictest3056-21PK-Backend21:52:581
4080951991917,1cyclictest3056-21PK-Backend20:56:411
4080951991917,1cyclictest3056-21PK-Backend00:31:011
4080951991917,1cyclictest0-21swapper/122:55:171
4080951991917,1cyclictest0-21swapper/122:39:081
4080951991917,1cyclictest0-21swapper/120:47:081
4080951991917,1cyclictest0-21swapper/120:33:561
4080951991912,5cyclictest4099139-21sshd19:55:411
408095199190,1cyclictest3056-21PK-Backend23:34:101
408095199190,1cyclictest3056-21PK-Backend23:05:111
408095199190,1cyclictest3056-21PK-Backend20:20:161
408095199190,1cyclictest3056-21PK-Backend20:08:071
408095199190,1cyclictest3056-21PK-Backend00:28:051
408095199190,1cyclictest3056-21PK-Backend00:22:581
408095199190,1cyclictest3056-21PK-Backend00:19:591
408095199190,1cyclictest3056-21PK-Backend00:19:591
408095199190,1cyclictest0-21swapper/122:16:171
408095199190,1cyclictest0-21swapper/121:27:431
408095199190,1cyclictest0-21swapper/121:27:421
408095199190,18cyclictest0-21swapper/120:27:341
408095199190,18cyclictest0-21swapper/120:27:341
408095099197,4cyclictest13-21ksoftirqd/000:13:400
408095099194,3cyclictest13-21ksoftirqd/023:01:250
4080950991917,1cyclictest0-21swapper/023:37:200
4080950991917,1cyclictest0-21swapper/021:44:370
408095099190,4cyclictest13-21ksoftirqd/021:10:010
408095099190,1cyclictest0-21swapper/020:53:270
408095099190,18cyclictest0-21swapper/021:10:030
4080958991815,2cyclictest3056-21PK-Backend20:36:233
4080958991813,3cyclictest4183250-21munin-run00:00:003
4080958991813,3cyclictest4151023-21if_enp2s022:25:153
4080958991813,3cyclictest4151023-21if_enp2s022:25:143
4080958991813,3cyclictest4107316-21df20:20:133
4080956991816,1cyclictest0-21swapper/222:36:382
4080956991816,1cyclictest0-21swapper/221:11:292
4080956991811,5cyclictest4161624-21tr22:55:172
4080951991816,1cyclictest3056-21PK-Backend21:46:361
4080951991816,1cyclictest3056-21PK-Backend21:44:401
4080951991816,1cyclictest0-21swapper/120:51:131
4080951991816,1cyclictest0-21swapper/119:22:101
4080951991813,3cyclictest4115360-21idleruntime-cro20:45:001
4080951991812,5cyclictest4122327-21systemd-run21:05:011
408095199180,1cyclictest0-21swapper/122:06:021
408095099188,4cyclictest13-21ksoftirqd/020:24:180
408095099185,4cyclictest13-21ksoftirqd/000:27:510
408095099182,9cyclictest13-21ksoftirqd/021:01:130
4080950991816,1cyclictest0-21swapper/021:53:100
4080950991816,1cyclictest0-21swapper/021:49:520
4080950991815,2cyclictest161rcuc/019:25:210
4080958991715,1cyclictest0-21swapper/320:19:273
4080958991715,1cyclictest0-21swapper/300:31:203
4080958991711,5cyclictest4141450-21wc22:00:013
4080958991710,6cyclictest4089254-21ls19:30:143
4080958991710,5cyclictest4110342-21date20:30:003
4080958991710,5cyclictest4110342-21date20:30:003
408095699179,6cyclictest34-21ksoftirqd/223:05:122
408095699179,2cyclictest34-21ksoftirqd/219:55:172
4080956991715,1cyclictest0-21swapper/223:24:382
4080956991712,4cyclictest34-21ksoftirqd/221:05:002
4080956991712,3cyclictest368-21cpuspeed_turbos00:30:112
4080956991711,5cyclictest4124137-21cat21:10:012
4080956991711,4cyclictest4139009-21awk21:50:182
408095199179,6cyclictest4093186-21ls19:40:161
408095199172,11cyclictest4181775-21apt23:55:121
4080951991715,1cyclictest3056-21PK-Backend23:24:021
4080951991715,1cyclictest0-21swapper/120:03:551
408095199170,16cyclictest3056-21PK-Backend23:01:531
4080950991715,1cyclictest0-21swapper/023:30:300
139099170,13rtkit-daemon3056-21PK-Backend21:11:223
408095699169,5cyclictest4152689-21df22:30:172
408095699169,5cyclictest4119958-21sensors_temp20:55:192
408095699169,5cyclictest4102205-21ntpq20:05:172
4080956991613,2cyclictest4172826-21cron23:30:002
4080956991613,2cyclictest4172826-21cron23:29:592
4080951991614,1cyclictest3056-21PK-Backend20:19:421
4080951991610,4cyclictest4096169-21grep19:50:121
408095699158,5cyclictest4159495-21ls22:50:112
408095199151,12cyclictest4180687-21needreboot23:50:171
408095199128,3cyclictest3056-21PK-Backend20:10:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional