You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-21 - 01:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Sat Jun 20, 2026 12:45:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
401829199136132,2cyclictest0-21swapper/011:45:030
401830099839,39cyclictest4062307-21ssh10:35:022
4018291997911,4cyclictest131rcu_preempt10:40:020
4018291997871,3cyclictest150-21pr/ttyS210:55:030
401829599757,6cyclictest131rcu_preempt09:10:021
4018302997364,7cyclictest37-21ksoftirqd/309:45:023
401829599701,17cyclictest4047905-21ssh10:02:331
4018291997066,2cyclictest0-21swapper/011:10:010
401829599692,20cyclictest4112478-21ssh12:28:471
401829599692,20cyclictest4112478-21ssh12:28:471
401829599682,20cyclictest4035194-21ssh09:34:021
401829599682,16cyclictest4097093-21ssh11:53:531
401830099677,7cyclictest131rcu_preempt08:40:012
4018295996631,31cyclictest23-21ksoftirqd/112:17:051
401829599662,17cyclictest4073795-21ssh11:00:541
4018295996619,43cyclictest4055462-21rm10:19:491
4018295996525,36cyclictest4033196-21sh09:29:391
401829599652,16cyclictest4055827-21ssh10:20:031
401829599652,13cyclictest48-21kcompactd010:05:331
401829599651,15cyclictest4045351-21ssh09:56:501
4018300996454,6cyclictest4022405-21kworker/2:311:45:002
4018300996454,6cyclictest4022405-21kworker/2:311:44:592
4018295996422,37cyclictest4024469-21diskmemload09:48:111
401829599642,17cyclictest4072231-21ssh10:57:351
401829599642,16cyclictest4063761-21ssh10:38:311
401829599642,14cyclictest4030177-21ssh09:22:291
401829599641,14cyclictest4105977-21ssh12:14:091
401829599641,14cyclictest4087246-21ssh11:31:251
4018302996314,6cyclictest131rcu_preempt11:10:013
401829599632,15cyclictest4028463-21ssh09:18:501
401829599632,14cyclictest4039047-21ssh09:42:311
401829599632,14cyclictest4026183-21ssh09:13:461
401829599632,13cyclictest4043667-21ssh09:53:091
401829599632,12cyclictest4058609-21ssh10:26:291
401829599631,15cyclictest4080413-21ssh11:15:531
401829599631,14cyclictest4075942-21rm11:05:481
401829599631,14cyclictest4060404-21ssh10:30:341
401829599631,13cyclictest4100120-21ssh12:00:241
401829599631,13cyclictest4098929-21ssh11:57:561
4018295996230,28cyclictest4091986-21sh11:42:151
4018295996230,28cyclictest4091986-21sh11:42:151
401829599621,9cyclictest4084934-21ssh11:26:081
401829599621,6cyclictest4021613-21munin-run08:15:011
401829599621,14cyclictest4116435-21ssh12:37:461
401829599621,14cyclictest4036154-21ssh09:35:521
401829599621,13cyclictest4115115-21ssh12:34:571
401829599621,13cyclictest4064725-21ssh10:40:211
4018302996112,6cyclictest131rcu_preempt09:10:003
401829599612,5cyclictest4021350-21munin-run08:10:001
401829599612,15cyclictest4051525-21ssh10:10:291
401829599612,14cyclictest4022940-21munin-run08:40:011
401829599612,14cyclictest4018499-21munin-run07:15:021
401829599612,14cyclictest4018499-21munin-run07:15:011
401829599612,13cyclictest4067175-21ssh10:45:521
401829599612,12cyclictest4069233-21ssh10:50:351
401829599611,8cyclictest4077897-21ssh11:10:121
401829599611,7cyclictest4095315-21ssh11:49:531
401829599611,13cyclictest4110154-21ssh12:23:261
401829599611,13cyclictest4103331-21ssh12:07:531
401829599611,12cyclictest4082677-21ssh11:21:031
4018291996122,6cyclictest309-21in:imuxsock10:24:160
4018300996050,6cyclictest4020074-21kworker/2:008:00:002
401829599602,5cyclictest4023696-21munin-run08:55:011
401829599601,12cyclictest4089452-21ssh11:36:241
401829599591,6cyclictest4019491-21sshd07:30:061
401829199591,41cyclictest4092076-21ssh11:42:270
401829199591,41cyclictest4092076-21ssh11:42:270
401829599582,5cyclictest364-21snmpd07:52:411
4018291995825,6cyclictest274-21cron10:10:010
4018291995823,23cyclictest0-21swapper/010:52:010
401829599572,5cyclictest4019290-21munin-run07:30:001
401829599571,14cyclictest4020779-21sshd07:55:111
4018291995728,13cyclictest4111094-21ssh12:25:230
4018291995728,13cyclictest4111094-21ssh12:25:230
4018302995628,8cyclictest37-21ksoftirqd/311:45:023
4018302995628,8cyclictest37-21ksoftirqd/311:45:023
4018300995647,5cyclictest4022405-21kworker/2:311:02:222
401829599562,5cyclictest4022394-21munin-run08:30:011
401829599561,14cyclictest364-21snmpd07:40:581
401829599561,11cyclictest364-21snmpd07:16:091
4018291995629,11cyclictest4075113-21ssh11:04:120
4018291995628,13cyclictest4100707-21ssh12:01:430
4018291995627,14cyclictest4083376-21ssh11:22:470
4018302995511,5cyclictest131rcu_preempt09:47:223
401829599552,11cyclictest364-21snmpd08:59:121
401829599551,5cyclictest4019823-21munin-run07:40:021
401829199559,6cyclictest0-21swapper/009:26:160
4018291995520,30cyclictest16850irq/134-800000010:47:570
4018291995519,31cyclictest16850irq/134-800000010:19:250
4018291995518,32cyclictest16850irq/134-800000012:31:130
401830299541,31cyclictest4066654-21ssh10:45:003
4018300995446,5cyclictest4066651-21kworker/2:011:31:152
4018300995443,7cyclictest4035567-21kworker/2:210:09:072
401829599543,5cyclictest364-21snmpd08:42:331
4018291995419,5cyclictest16850irq/134-800000011:31:260
4018291995418,32cyclictest16850irq/134-800000009:35:350
4018291995418,32cyclictest16850irq/134-800000009:18:060
4018291995418,31cyclictest16850irq/134-800000012:13:490
4018291995416,33cyclictest16850irq/134-800000009:45:130
401830299537,6cyclictest131rcu_preempt09:56:163
4018302995333,14cyclictest3467602-21systemd-journal10:25:013
4018300995344,5cyclictest4066651-21kworker/2:011:13:092
4018300995344,5cyclictest4022405-21kworker/2:312:36:062
4018300995334,15cyclictest3467602-21systemd-journal09:05:002
4018300995331,11cyclictest30-21ksoftirqd/212:20:002
401829599535,43cyclictest0-21swapper/107:47:591
401829599532,6cyclictest364-21snmpd08:33:441
4018295995317,33cyclictest23-21ksoftirqd/109:05:011
4018291995328,10cyclictest4096394-21ssh11:52:070
4018291995318,6cyclictest16850irq/134-800000012:17:050
4018291995318,6cyclictest16850irq/134-800000010:11:180
4018291995318,31cyclictest16850irq/134-800000012:37:410
4018291995318,31cyclictest16850irq/134-800000010:32:540
4018291995317,31cyclictest16850irq/134-800000012:05:070
4018291995316,32cyclictest16850irq/134-800000009:40:200
4018302995229,16cyclictest3467602-21systemd-journal07:25:013
4018302995229,16cyclictest3467602-21systemd-journal07:25:013
4018302995210,6cyclictest131rcu_preempt10:55:013
4018300995244,5cyclictest4022405-21kworker/2:309:25:522
4018300995243,5cyclictest4035567-21kworker/2:209:57:322
4018300995243,5cyclictest4022405-21kworker/2:309:40:022
401829599522,5cyclictest364-21snmpd08:00:411
401829599522,5cyclictest364-21snmpd08:00:411
401829599522,17cyclictest4022027-21cat08:20:021
4018291995236,12cyclictest1-21systemd09:10:000
4018291995218,6cyclictest16850irq/134-800000011:37:190
4018291995217,6cyclictest16850irq/134-800000009:50:490
4018291995216,6cyclictest16850irq/134-800000009:22:030
4018291995216,31cyclictest16850irq/134-800000009:32:270
4018302995135,11cyclictest37-21ksoftirqd/312:20:003
401830299511,11cyclictest37-21ksoftirqd/310:50:003
4018300995143,5cyclictest4066651-21kworker/2:011:06:222
4018291995122,5cyclictest4081525-21sh11:18:470
4018291995117,5cyclictest16850irq/134-800000011:13:350
4018291995117,30cyclictest16850irq/134-800000011:28:240
4018291995117,29cyclictest16850irq/134-800000010:25:550
4018291995116,31cyclictest16850irq/134-800000012:24:300
4018291995116,30cyclictest16850irq/134-800000009:10:440
401829199511,3cyclictest131rcu_preempt09:56:160
4018302995033,12cyclictest37-21ksoftirqd/310:40:013
4018300995042,5cyclictest4035567-21kworker/2:210:28:452
4018300995042,5cyclictest4022405-21kworker/2:312:21:202
4018300995042,5cyclictest4022405-21kworker/2:312:07:312
4018300995042,5cyclictest4022405-21kworker/2:310:44:192
4018300995036,10cyclictest3467602-21systemd-journal08:20:022
401829599502,4cyclictest0-21swapper/108:22:241
4018302994914,9cyclictest131rcu_preempt11:15:013
4018302994912,6cyclictest131rcu_preempt08:59:593
4018300994941,5cyclictest4022405-21kworker/2:310:45:362
4018300994940,5cyclictest4019034-21kworker/2:109:00:012
4018300994939,6cyclictest4022405-21kworker/2:312:13:562
4018300994930,9cyclictest4035567-21kworker/2:210:02:292
401829599491,5cyclictest364-21snmpd08:45:241
401830299487,9cyclictest37-21ksoftirqd/312:28:053
401830299487,9cyclictest37-21ksoftirqd/312:28:053
4018302994839,6cyclictest37-21ksoftirqd/312:10:043
4018302994835,10cyclictest37-21ksoftirqd/312:05:013
401830299482,4cyclictest131rcu_preempt12:40:013
401830299481,9cyclictest37-21ksoftirqd/310:10:023
4018300994840,5cyclictest4066651-21kworker/2:011:26:452
4018300994839,6cyclictest4066651-21kworker/2:010:59:592
4018300994839,6cyclictest4022405-21kworker/2:309:54:022
4018300994839,5cyclictest4022405-21kworker/2:311:48:542
401829599482,4cyclictest0-21swapper/107:23:371
401829599482,4cyclictest0-21swapper/107:23:361
401829199482,41cyclictest4023975-21munin-run09:00:010
4018291994813,6cyclictest16850irq/134-800000010:40:260
401830299474,12cyclictest37-21ksoftirqd/311:50:013
4018302994722,16cyclictest275-21dbus-daemon07:40:013
4018302994714,5cyclictest131rcu_preempt09:15:303
4018302994712,6cyclictest131rcu_preempt08:20:003
4018302994711,6cyclictest131rcu_preempt11:20:003
4018300994739,5cyclictest4035567-21kworker/2:210:38:462
4018300994739,5cyclictest4022405-21kworker/2:311:16:192
4018300994739,5cyclictest4022405-21kworker/2:309:43:302
4018300994739,5cyclictest4022405-21kworker/2:309:18:332
4018300994738,6cyclictest4022405-21kworker/2:312:29:252
4018300994738,6cyclictest4022405-21kworker/2:312:29:252
4018300994738,6cyclictest4022405-21kworker/2:311:20:102
4018300994732,11cyclictest1-21systemd09:35:012
4018291994735,8cyclictest4021847-21cron08:20:010
4018291994731,11cyclictest275-21dbus-daemon08:45:010
4018291994715,28cyclictest12-21ksoftirqd/010:02:560
4018291994712,6cyclictest16850irq/134-800000011:59:120
401830299464,6cyclictest131rcu_preempt12:13:103
4018302994630,11cyclictest1-21systemd12:35:013
4018302994627,14cyclictest275-21dbus-daemon08:50:013
4018302994610,6cyclictest131rcu_preempt08:05:023
4018302994610,6cyclictest131rcu_preempt08:05:013
4018300994637,6cyclictest4022405-21kworker/2:311:57:322
4018300994637,6cyclictest4019034-21kworker/2:108:47:252
4018300994637,5cyclictest4022405-21kworker/2:309:20:052
4018300994637,5cyclictest4021888-21sendmail-msp08:20:012
4018300994636,6cyclictest4022405-21kworker/2:309:50:022
4018300994635,7cyclictest309-21in:imuxsock10:20:012
4018291994628,14cyclictest1-21systemd08:10:010
401830299459,6cyclictest131rcu_preempt11:31:023
4018302994537,6cyclictest37-21ksoftirqd/310:03:313
4018302994535,7cyclictest37-21ksoftirqd/309:34:363
4018302994532,10cyclictest37-21ksoftirqd/308:40:023
4018302994527,14cyclictest3467602-21systemd-journal11:25:003
4018302994524,15cyclictest4020803-21cron08:00:003
401830299451,4cyclictest131rcu_preempt11:52:443
4018300994537,5cyclictest4022405-21kworker/2:311:50:352
4018300994532,9cyclictest1-21systemd07:45:012
4018300994531,10cyclictest4019853-21sed07:40:022
401829199452,12cyclictest4019792-21munin-run07:40:000
4018302994432,8cyclictest37-21ksoftirqd/311:05:013
4018302994432,7cyclictest37-21ksoftirqd/310:57:063
401830299441,7cyclictest4026660-21ssh09:15:003
4018302994414,6cyclictest131rcu_preempt11:27:063
4018300994436,5cyclictest4019034-21kworker/2:108:15:022
401830099443,3cyclictest131rcu_preempt07:15:022
401830099443,3cyclictest131rcu_preempt07:15:012
4018300994427,12cyclictest275-21dbus-daemon09:10:012
401830099442,3cyclictest131rcu_preempt12:33:122
4018300994414,9cyclictest4019034-21kworker/2:107:49:592
401830099441,3cyclictest131rcu_preempt10:51:572
401830299436,7cyclictest37-21ksoftirqd/311:39:233
401830299432,7cyclictest37-21ksoftirqd/309:25:233
4018302994317,9cyclictest131rcu_preempt10:11:273
4018302994312,6cyclictest131rcu_preempt09:23:493
401830099434,3cyclictest131rcu_preempt12:00:452
4018300994327,12cyclictest3467602-21systemd-journal10:25:002
401830099431,3cyclictest131rcu_preempt09:12:172
4018291994336,4cyclictest16950irq/224-800000008:50:000
401830299428,6cyclictest131rcu_preempt09:37:153
401830299425,8cyclictest37-21ksoftirqd/310:30:433
401830299424,8cyclictest37-21ksoftirqd/310:19:173
4018302994235,5cyclictest37-21ksoftirqd/310:26:233
4018302994215,5cyclictest131rcu_preempt08:10:023
4018302994212,5cyclictest131rcu_preempt09:05:013
401830099424,3cyclictest131rcu_preempt10:10:112
401830099422,3cyclictest131rcu_preempt11:39:142
4018295994227,12cyclictest23-21ksoftirqd/107:10:021
4018291994226,13cyclictest12-21ksoftirqd/008:40:020
401829199422,5cyclictest1-21systemd08:00:000
4018291994223,14cyclictest3467602-21systemd-journal08:25:010
4018291994220,15cyclictest275-21dbus-daemon08:35:010
401829199421,23cyclictest131rcu_preempt07:32:160
4018291994211,5cyclictest131rcu_preempt08:15:000
401830299416,5cyclictest131rcu_preempt09:51:213
4018302994132,6cyclictest37-21ksoftirqd/307:55:003
4018302994131,7cyclictest37-21ksoftirqd/311:56:003
4018302994130,7cyclictest37-21ksoftirqd/307:15:023
4018302994130,7cyclictest37-21ksoftirqd/307:15:023
4018302994129,6cyclictest37-21ksoftirqd/307:30:003
4018302994125,11cyclictest275-21dbus-daemon07:19:593
4018302994110,5cyclictest131rcu_preempt08:15:003
4018300994131,6cyclictest4019034-21kworker/2:107:30:002
4018300994125,11cyclictest1-21systemd07:55:022
401829199412,34cyclictest0-21swapper/007:20:000
401829199411,36cyclictest4020028-21sshd07:40:170
401830299408,6cyclictest131rcu_preempt12:20:053
4018300994030,7cyclictest1-21systemd08:35:012
4018300994029,8cyclictest1-21systemd08:10:002
4018300994029,6cyclictest4018703-21kworker/2:007:25:012
4018300994029,6cyclictest4018703-21kworker/2:007:25:002
401830299397,5cyclictest131rcu_preempt07:35:023
401830099391,5cyclictest4021065-21sshd08:00:162
401830099391,5cyclictest4021065-21sshd08:00:152
401830099391,3cyclictest131rcu_preempt07:35:012
401830099391,3cyclictest131rcu_preempt07:10:022
4018302993827,8cyclictest37-21ksoftirqd/308:45:003
4018302993817,17cyclictest37-21ksoftirqd/307:45:163
4018300993828,6cyclictest4019034-21kworker/2:108:45:002
401830099381,3cyclictest131rcu_preempt08:55:002
401829199381,9cyclictest4018996-21sshd07:21:160
401829199381,9cyclictest4018996-21sshd07:21:150
4018291993814,6cyclictest131rcu_preempt08:05:010
4018291993814,6cyclictest131rcu_preempt08:05:000
4018302993727,7cyclictest37-21ksoftirqd/307:45:013
401829199371,6cyclictest0-21swapper/007:27:370
4018302993628,6cyclictest37-21ksoftirqd/307:10:013
401830299362,5cyclictest131rcu_preempt08:25:013
401829199361,5cyclictest4018486-21munin-run07:15:010
401829199361,5cyclictest4018486-21munin-run07:15:000
401830299354,7cyclictest37-21ksoftirqd/308:30:183
401830099352,3cyclictest131rcu_preempt08:30:012
4018300993521,10cyclictest30-21ksoftirqd/207:20:022
4018291993524,8cyclictest12-21ksoftirqd/008:30:000
401829199352,30cyclictest0-21swapper/008:52:280
4018291993522,9cyclictest0-21swapper/007:55:030
4018302993425,7cyclictest37-21ksoftirqd/308:30:003
401829199343,3cyclictest131rcu_preempt07:50:000
4018291993428,4cyclictest0-21swapper/009:04:080
4018302993321,7cyclictest4023670-21cron08:55:003
401829199326,22cyclictest0-21swapper/007:10:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional