You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 13:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot7s.osadl.org (updated Sun May 03, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
50566522390,5sleep30-21swapper/319:05:023
50653421320,9sleep00-21swapper/019:05:240
55854121280,4sleep33056-21PK-Backend21:30:193
139099850,69rtkit-daemon0-21swapper/119:09:451
50709427836,14sleep20-21swapper/219:08:192
5187742450,3sleep33056-21PK-Backend19:40:013
6054952400,4sleep13056-21PK-Backend23:45:181
5485742380,3sleep33056-21PK-Backend21:05:013
5221472380,4sleep20-21swapper/219:49:062
50745799272,21cyclictest978-21snmpd21:15:213
50745499260,24cyclictest579616-21runrttasks22:30:502
50745499260,24cyclictest579616-21runrttasks22:30:502
50744099267,3cyclictest141rcu_preempt21:30:000
6031582250,3sleep33056-21PK-Backend23:40:113
5620712250,4sleep20-21swapper/221:40:212
50745799252,20cyclictest554231-21apt21:20:103
139099250,4rtkit-daemon1389-21rtkit-daemon23:24:560
139099250,4rtkit-daemon1389-21rtkit-daemon22:14:490
507457992415,8cyclictest514849-21awk19:25:213
5379862230,4sleep23056-21PK-Backend20:35:002
5379862230,4sleep23056-21PK-Backend20:35:002
507454992321,1cyclictest0-21swapper/219:39:002
50744899230,22cyclictest0-21swapper/119:47:531
5964782220,10chrt411rcuc/323:20:143
507457992215,4cyclictest605615-21python323:45:203
507454992220,1cyclictest0-21swapper/223:56:142
507454992220,1cyclictest0-21swapper/219:27:522
507454992216,4cyclictest612808-21fwupdmgr00:05:352
507454992213,7cyclictest522871-21df_inode19:50:132
50745499220,21cyclictest0-21swapper/221:46:492
50745499220,21cyclictest0-21swapper/220:29:502
50745499220,20cyclictest0-21swapper/221:12:082
507440992220,1cyclictest0-21swapper/023:10:510
507440992220,1cyclictest0-21swapper/022:05:140
507440992220,1cyclictest0-21swapper/021:39:530
507440992220,1cyclictest0-21swapper/019:58:200
507440992218,3cyclictest614002-21expr00:10:130
507457992119,1cyclictest3056-21PK-Backend20:30:203
507457992119,1cyclictest3056-21PK-Backend20:30:203
507457992119,1cyclictest0-21swapper/322:31:203
507457992119,1cyclictest0-21swapper/322:31:203
507457992116,3cyclictest541964-21hddtemp_smartct20:45:163
50745799210,20cyclictest3056-21PK-Backend21:45:373
50745799210,20cyclictest3056-21PK-Backend21:10:493
50745799210,20cyclictest0-21swapper/300:00:023
50745799210,19cyclictest978-21snmpd00:30:133
50745799210,19cyclictest3056-21PK-Backend21:40:573
50745799210,19cyclictest3056-21PK-Backend20:26:493
50745799210,19cyclictest3056-21PK-Backend19:55:463
507454992119,1cyclictest0-21swapper/223:49:382
507454992119,1cyclictest0-21swapper/223:11:122
507454992119,1cyclictest0-21swapper/222:19:282
507454992119,1cyclictest0-21swapper/221:16:142
507454992119,1cyclictest0-21swapper/220:50:392
507454992119,1cyclictest0-21swapper/220:10:512
507454992119,1cyclictest0-21swapper/220:09:022
507454992119,1cyclictest0-21swapper/219:20:222
507454992119,1cyclictest0-21swapper/219:10:282
507454992113,6cyclictest566548-21expr21:55:122
50745499210,20cyclictest0-21swapper/222:45:032
50745499210,20cyclictest0-21swapper/219:42:592
50745499210,19cyclictest3056-21PK-Backend23:15:112
507448992112,7cyclictest532900-21apt20:20:101
50744899210,20cyclictest0-21swapper/120:30:181
50744899210,20cyclictest0-21swapper/120:30:181
50744899210,1cyclictest3056-21PK-Backend19:25:021
50744099216,13cyclictest1-21systemd20:45:000
507440992119,1cyclictest0-21swapper/023:45:390
507440992119,1cyclictest0-21swapper/023:40:530
507440992119,1cyclictest0-21swapper/023:25:450
507440992119,1cyclictest0-21swapper/022:17:450
507440992119,1cyclictest0-21swapper/021:54:060
507440992119,1cyclictest0-21swapper/021:43:110
507440992119,1cyclictest0-21swapper/021:12:150
507440992119,1cyclictest0-21swapper/021:04:180
507440992119,1cyclictest0-21swapper/019:41:230
507440992119,1cyclictest0-21swapper/019:27:510
507440992119,1cyclictest0-21swapper/000:39:060
50744099210,20cyclictest0-21swapper/023:01:320
50744099210,20cyclictest0-21swapper/022:29:410
50744099210,20cyclictest0-21swapper/020:45:180
50744099210,20cyclictest0-21swapper/020:12:120
50744099210,20cyclictest0-21swapper/020:01:460
50744099210,20cyclictest0-21swapper/019:51:440
50744099210,20cyclictest0-21swapper/019:20:210
50744099210,20cyclictest0-21swapper/019:10:270
507457992018,1cyclictest0-21swapper/321:56:323
507457992018,1cyclictest0-21swapper/320:38:453
507457992017,2cyclictest3056-21PK-Backend20:00:463
507457992013,5cyclictest609143-21cat23:55:213
507457992012,6cyclictest585141-21cron22:50:003
50745799200,1cyclictest3056-21PK-Backend21:05:363
50745799200,19cyclictest0-21swapper/323:06:083
50745799200,19cyclictest0-21swapper/319:33:293
50745799200,19cyclictest0-21swapper/319:33:293
50745799200,18cyclictest3056-21PK-Backend20:24:053
50745499204,15cyclictest1095-21runrttasks20:45:332
507454992018,1cyclictest0-21swapper/222:53:212
507454992018,1cyclictest0-21swapper/222:40:302
507454992018,1cyclictest0-21swapper/220:40:382
507454992018,1cyclictest0-21swapper/220:16:132
507454992018,1cyclictest0-21swapper/219:17:382
507454992018,1cyclictest0-21swapper/200:26:362
507454992018,1cyclictest0-21swapper/200:26:362
50745499200,1cyclictest0-21swapper/220:24:572
50745499200,19cyclictest0-21swapper/222:35:092
50745499200,19cyclictest0-21swapper/222:11:042
50745499200,19cyclictest0-21swapper/219:57:462
50745499200,19cyclictest0-21swapper/200:37:312
507448992018,1cyclictest3056-21PK-Backend00:31:291
507448992018,1cyclictest0-21swapper/120:12:131
507448992017,2cyclictest3056-21PK-Backend22:39:011
507448992017,2cyclictest3056-21PK-Backend21:14:521
507448992017,2cyclictest3056-21PK-Backend20:54:531
507448992017,2cyclictest0-21swapper/119:37:121
50744899200,1cyclictest0-21swapper/100:15:201
50744899200,19cyclictest3056-21PK-Backend21:55:151
50744899200,19cyclictest0-21swapper/120:09:361
50744899200,18cyclictest3056-21PK-Backend19:18:261
50744899200,18cyclictest3056-21PK-Backend19:10:351
507440992019,1cyclictest0-21swapper/020:35:520
507440992018,1cyclictest0-21swapper/023:53:500
507440992018,1cyclictest0-21swapper/023:36:060
507440992018,1cyclictest0-21swapper/022:40:090
507440992018,1cyclictest0-21swapper/022:34:010
507440992018,1cyclictest0-21swapper/022:34:010
507440992018,1cyclictest0-21swapper/021:32:230
507440992018,1cyclictest0-21swapper/021:22:220
507440992018,1cyclictest0-21swapper/019:39:000
507440992018,1cyclictest0-21swapper/019:30:160
507440992018,1cyclictest0-21swapper/019:30:150
507440992016,2cyclictest13-21ksoftirqd/022:50:000
50744099200,1cyclictest0-21swapper/020:54:370
50744099200,19cyclictest0-21swapper/022:00:210
50744099200,19cyclictest0-21swapper/020:56:330
50744099200,19cyclictest0-21swapper/020:30:100
50744099200,19cyclictest0-21swapper/020:30:100
50744099200,19cyclictest0-21swapper/000:33:380
50744099200,19cyclictest0-21swapper/000:20:540
5452182190,4sleep23056-21PK-Backend20:55:012
507457991917,1cyclictest3056-21PK-Backend21:27:193
507457991917,1cyclictest0-21swapper/322:27:493
507457991917,1cyclictest0-21swapper/322:13:083
507457991917,1cyclictest0-21swapper/322:05:313
507457991917,1cyclictest0-21swapper/320:50:553
507457991917,1cyclictest0-21swapper/319:21:123
507457991917,1cyclictest0-21swapper/300:37:403
507457991917,1cyclictest0-21swapper/300:26:453
507457991917,1cyclictest0-21swapper/300:26:453
507457991914,3cyclictest580596-21df_inode22:35:133
507457991914,3cyclictest510793-21ntp_states19:15:193
507457991912,5cyclictest588184-21cat22:55:223
507457991912,5cyclictest508888-21cat19:10:223
50745799190,7cyclictest588869-21basename23:00:093
50745799190,1cyclictest3056-21PK-Backend22:20:453
50745799190,1cyclictest3056-21PK-Backend20:05:483
50745799190,1cyclictest3056-21PK-Backend00:07:123
50745799190,1cyclictest0-21swapper/322:03:223
50745799190,18cyclictest3056-21PK-Backend19:41:273
507454991917,1cyclictest0-21swapper/223:32:422
507454991917,1cyclictest0-21swapper/222:55:442
507454991917,1cyclictest0-21swapper/220:36:192
507454991917,1cyclictest0-21swapper/200:23:452
507454991916,2cyclictest3056-21PK-Backend22:20:152
507454991914,4cyclictest978-21snmpd21:29:202
507454991913,5cyclictest615167-21cron00:15:012
507454991912,5cyclictest570733-21switchtime22:05:212
507454991912,5cyclictest554613-21cat21:20:132
50745499190,1cyclictest0-21swapper/221:37:302
50745499190,1cyclictest0-21swapper/221:00:532
50745499190,18cyclictest0-21swapper/221:33:042
50745499190,18cyclictest0-21swapper/220:04:362
507448991917,1cyclictest0-21swapper/121:48:391
507448991917,1cyclictest0-21swapper/121:26:351
507448991917,1cyclictest0-21swapper/100:09:261
507448991913,4cyclictest523074-21cat19:50:161
507448991912,5cyclictest575659-21cat22:20:181
507448991911,6cyclictest565524-21sed21:50:221
50744899190,1cyclictest3056-21PK-Backend23:09:301
50744899190,1cyclictest3056-21PK-Backend22:50:441
50744899190,1cyclictest3056-21PK-Backend22:45:171
50744899190,1cyclictest3056-21PK-Backend19:30:431
50744899190,1cyclictest3056-21PK-Backend19:30:431
50744899190,1cyclictest3056-21PK-Backend00:27:171
50744899190,1cyclictest3056-21PK-Backend00:27:171
50744899190,1cyclictest3056-21PK-Backend00:03:311
50744899190,1cyclictest0-21swapper/122:15:431
50744899190,1cyclictest0-21swapper/121:41:291
50744899190,1cyclictest0-21swapper/120:18:151
50744899190,1cyclictest0-21swapper/100:14:331
50744899190,18cyclictest3056-21PK-Backend22:03:331
50744899190,18cyclictest0-21swapper/123:28:361
507440991917,1cyclictest0-21swapper/023:15:380
507440991917,1cyclictest0-21swapper/021:18:170
507440991914,3cyclictest521638-21python319:45:220
507440991912,5cyclictest533040-21grep20:20:110
507440991911,2cyclictest13-21ksoftirqd/019:20:010
50744099190,1cyclictest0-21swapper/022:59:080
50744099190,1cyclictest0-21swapper/022:21:160
50744099190,1cyclictest0-21swapper/021:07:350
50744099190,1cyclictest0-21swapper/020:16:320
50744099190,1cyclictest0-21swapper/020:07:460
5987142180,4sleep33056-21PK-Backend23:25:193
507457991816,1cyclictest0-21swapper/300:24:563
507457991816,1cyclictest0-21swapper/300:11:583
507457991815,2cyclictest3056-21PK-Backend21:35:233
507457991811,5cyclictest540118-21expr20:40:113
507454991816,1cyclictest0-21swapper/223:20:452
507454991816,1cyclictest0-21swapper/223:09:372
507454991813,3cyclictest606645-21grep23:50:132
507454991811,5cyclictest515903-21cat19:30:152
507454991811,5cyclictest515903-21cat19:30:152
507448991816,1cyclictest0-21swapper/123:19:441
507448991816,1cyclictest0-21swapper/119:41:441
507448991815,2cyclictest3056-21PK-Backend20:40:251
507448991812,4cyclictest601818-21cat23:35:161
507448991812,4cyclictest1-21systemd21:10:011
507448991810,6cyclictest883-21dbus-daemon23:25:001
507440991816,1cyclictest0-21swapper/023:09:160
507440991816,1cyclictest0-21swapper/021:47:160
507440991816,1cyclictest0-21swapper/000:05:130
507440991812,5cyclictest566846-21cut21:55:170
507440991811,5cyclictest581676-21cron22:40:000
50744099180,16cyclictest436-20systemd-journal23:35:000
507457991715,1cyclictest3056-21PK-Backend19:54:583
507457991715,1cyclictest3056-21PK-Backend00:19:423
507457991715,1cyclictest0-21swapper/322:52:153
507457991711,4cyclictest593499-21sshd23:11:053
50745799170,15cyclictest581960-21apt22:40:103
507454991715,1cyclictest0-21swapper/223:03:282
507454991715,1cyclictest0-21swapper/222:25:572
507454991715,1cyclictest0-21swapper/221:50:212
507454991715,1cyclictest0-21swapper/221:05:332
507454991710,5cyclictest622151-21wc00:35:002
507454991710,5cyclictest598829-21expr23:25:202
507454991710,5cyclictest568538-21cat22:00:152
507448991712,3cyclictest558605-21switchtime21:30:201
507448991711,5cyclictest576899-21grep22:25:111
507448991711,5cyclictest26-21ksoftirqd/123:30:131
507448991710,5cyclictest538468-21df20:35:141
50744099172,10cyclictest978-21snmpd20:25:090
507440991715,1cyclictest0-21swapper/022:53:000
507440991711,4cyclictest620384-21sh00:30:000
507440991711,4cyclictest620384-21sh00:30:000
507457991614,1cyclictest3056-21PK-Backend23:19:263
507457991610,5cyclictest42-21ksoftirqd/323:50:143
50744899169,5cyclictest617881-21ntpq00:20:191
50744899169,5cyclictest545508-21expr20:55:121
50744899169,5cyclictest535626-21cat20:25:201
507448991614,1cyclictest3056-21PK-Backend22:55:381
507448991614,1cyclictest3056-21PK-Backend19:20:221
507448991613,2cyclictest3056-21PK-Backend23:10:181
507448991613,2cyclictest3056-21PK-Backend22:41:111
507448991612,3cyclictest526549-21missed_timers20:00:171
507448991610,4cyclictest525918-21cut20:00:011
50744899160,15cyclictest3056-21PK-Backend23:00:311
50744099165,8cyclictest883-21dbus-daemon00:00:010
507440991612,2cyclictest616906-21latency_hist00:20:000
507440991612,2cyclictest13-21ksoftirqd/000:00:010
507457991513,1cyclictest3056-21PK-Backend23:35:083
507457991513,1cyclictest3056-21PK-Backend21:51:053
507457991513,1cyclictest3056-21PK-Backend20:17:293
507457991513,1cyclictest3056-21PK-Backend20:14:123
50745799150,3cyclictest574597-21chrt22:18:073
50745799150,3cyclictest521624-21grep19:45:223
50745499158,5cyclictest602734-21cron23:40:002
507454991512,2cyclictest609975-21apt00:00:112
507454991510,3cyclictest604024-21timerwakeupswit23:40:202
50744899159,4cyclictest559605-21grep21:35:141
50744899159,4cyclictest26-21ksoftirqd/123:40:191
50744899158,5cyclictest1-21systemd21:05:011
50744899153,2cyclictest141rcu_preempt00:00:011
507448991513,1cyclictest3056-21PK-Backend22:11:511
507448991513,1cyclictest3056-21PK-Backend20:45:051
50745799147,5cyclictest436-20systemd-journal20:55:053
50745799140,12cyclictest599528-21/usr/sbin/munin23:30:163
50745499148,5cyclictest615680-21expr00:15:132
507448991410,3cyclictest3056-21PK-Backend00:37:391
50744899140,1cyclictest3056-21PK-Backend22:05:291
507448991311,1cyclictest3056-21PK-Backend21:21:491
50744899128,3cyclictest3056-21PK-Backend21:19:511
50744899122,2cyclictest141rcu_preempt23:53:191
50744899120,4cyclictest141rcu_preempt22:30:151
50744899120,4cyclictest141rcu_preempt22:30:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional