You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 07:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Sep 03, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4409211079,6sleep20-21swapper/219:05:542
4667210886,17sleep30-21swapper/319:08:513
4650210784,18sleep10-21swapper/119:08:371
4412210796,6sleep00-21swapper/019:05:560
91492790,1sleep2301ktimersoftd/222:02:282
307882750,0sleep30-21swapper/322:56:403
246512740,0sleep20-21swapper/223:55:392
50162710,1sleep30-21swapper/323:35:533
88002680,0sleep10-21swapper/100:12:501
292952680,0sleep00-21swapper/023:28:130
14752670,0sleep30-21swapper/300:38:223
230852580,1sleep30-21swapper/321:44:413
320532490,1sleep132052-21ssh23:30:291
4784993628,7cyclictest0-21swapper/119:40:111
305512270,0sleep30-21swapper/300:01:553
4784992320,2cyclictest274-21jbd2/sda1-822:25:111
4785992219,2cyclictest27471-21kworker/u8:100:32:042
478499221,4cyclictest0-21swapper/119:14:041
478499211,3cyclictest0-21swapper/100:39:041
478499211,2cyclictest0-21swapper/122:10:171
478499210,4cyclictest0-21swapper/120:40:031
4783992118,2cyclictest16039-21kworker/u8:223:42:050
175782210,1sleep10-21swapper/122:44:081
4784992016,3cyclictest2850-21rsyslogd21:35:131
478499200,3cyclictest0-21swapper/123:36:041
478499200,3cyclictest0-21swapper/122:56:051
478499200,3cyclictest0-21swapper/122:54:051
478499200,3cyclictest0-21swapper/122:32:011
478499200,3cyclictest0-21swapper/122:15:041
478499200,3cyclictest0-21swapper/119:28:051
4783992017,2cyclictest32103-21kworker/u8:122:18:040
4785991916,2cyclictest3319-21kworker/u8:000:04:052
478499190,3cyclictest0-21swapper/119:50:061
4783991916,2cyclictest7891-21kworker/u8:021:30:040
4783991916,2cyclictest32103-21kworker/u8:122:07:040
4783991916,2cyclictest26584-21kworker/u8:122:58:040
478699180,16cyclictest0-21swapper/322:19:543
4783991815,2cyclictest26584-21kworker/u8:123:22:050
478399180,2cyclictest28130-21ssh00:32:040
4785991714,2cyclictest19036-21kworker/u8:022:29:042
478599170,15cyclictest0-21swapper/223:42:042
478499170,4cyclictest0-21swapper/121:09:041
478699161,3cyclictest0-21swapper/320:30:013
4786991611,3cyclictest0-21swapper/323:56:033
4785991613,2cyclictest13162-21kworker/u8:121:39:052
4783991613,2cyclictest32103-21kworker/u8:121:58:040
4783991613,2cyclictest18426-21kworker/u8:200:19:050
4783991613,2cyclictest16039-21kworker/u8:223:34:050
478699152,7cyclictest5911-21copy22:00:013
478699152,7cyclictest18447-21ssh21:40:003
478699151,3cyclictest8975-21entropy22:35:143
4786991510,3cyclictest25893-21aten2.4_r3power23:25:123
4786991510,3cyclictest0-21swapper/322:30:163
4785991512,2cyclictest18426-21kworker/u8:200:17:042
4785991511,2cyclictest10882-21latency_hist19:25:002
478599150,2cyclictest0-21swapper/222:18:042
478599150,13cyclictest12562-21ssh21:33:472
478499152,2cyclictest17656-21wget21:00:151
478499152,11cyclictest19939-21cut22:45:501
478499150,13cyclictest0-21swapper/123:54:531
4783991512,2cyclictest25004-21kworker/u8:222:38:040
4783991512,2cyclictest19036-21kworker/u8:022:29:020
4783991512,2cyclictest13677-21kworker/u8:022:47:040
478399151,12cyclictest0-21swapper/023:10:000
478399150,3cyclictest3649-21snmpd20:01:040
478399150,14cyclictest0-21swapper/000:26:560
478399150,13cyclictest0-21swapper/021:41:240
478699142,7cyclictest0-21swapper/321:25:013
478699142,6cyclictest0-21swapper/300:20:003
4786991410,2cyclictest12975-21cat19:30:003
478699140,13cyclictest0-21swapper/323:30:083
478699140,13cyclictest0-21swapper/300:30:183
478699140,12cyclictest4977-21ssh21:25:283
4785991411,2cyclictest20870-21diskmemload00:20:132
4785991411,2cyclictest20676-21kworker/u8:000:29:052
4785991411,2cyclictest0-21swapper/221:54:312
4785991411,2cyclictest0-21swapper/221:46:482
4785991411,2cyclictest0-21swapper/221:11:262
4785991411,2cyclictest0-21swapper/220:55:172
478599140,2cyclictest0-21swapper/222:13:182
478599140,2cyclictest0-21swapper/222:05:172
478599140,2cyclictest0-21swapper/220:25:102
478599140,12cyclictest28923-21sendmail-mta00:36:052
478599140,12cyclictest27559-21ssh21:15:482
478599140,12cyclictest14904-21ssh23:13:572
478599140,12cyclictest0-21swapper/223:21:522
478599140,12cyclictest0-21swapper/222:45:592
478499147,6cyclictest21-21rcuc/123:59:581
4784991411,2cyclictest0-21swapper/122:06:471
478499141,11cyclictest0-21swapper/121:51:171
4784991410,2cyclictest0-21swapper/123:19:061
478499140,3cyclictest15219-21sh19:35:131
478499140,3cyclictest0-21swapper/121:49:091
478499140,2cyclictest0-21swapper/121:20:261
478499140,13cyclictest0-21swapper/121:16:131
478499140,12cyclictest23-21ksoftirqd/100:25:521
478499140,12cyclictest0-21swapper/122:23:361
478399141,3cyclictest31225-21rm21:52:030
4783991411,2cyclictest26584-21kworker/u8:123:18:020
4783991411,2cyclictest25004-21kworker/u8:222:31:040
4783991411,2cyclictest23656-21kworker/u8:021:47:040
4783991411,2cyclictest15140-21kworker/u8:222:12:050
478399140,12cyclictest22998-21copy19:55:020
478399140,12cyclictest0-21swapper/023:51:450
478399140,12cyclictest0-21swapper/022:50:120
478399140,12cyclictest0-21swapper/021:15:140
296192140,2sleep00-21swapper/000:00:390
478699139,2cyclictest14843-21apt-get19:35:063
478699132,6cyclictest0-21swapper/322:55:003
4786991310,2cyclictest0-21swapper/320:35:163
4786991310,2cyclictest0-21swapper/320:10:003
4786991310,2cyclictest0-21swapper/319:30:113
4786991310,2cyclictest0-21swapper/300:25:203
478699130,2cyclictest0-21swapper/323:44:283
478699130,2cyclictest0-21swapper/321:48:593
478699130,12cyclictest0-21swapper/322:11:353
4785991310,2cyclictest3210-21kworker/u8:100:09:042
4785991310,2cyclictest274-21jbd2/sda1-823:26:052
4785991310,2cyclictest20595-21ssh21:41:042
4785991310,2cyclictest0-21swapper/223:36:492
4785991310,2cyclictest0-21swapper/223:30:052
4785991310,2cyclictest0-21swapper/223:15:562
4785991310,2cyclictest0-21swapper/223:02:532
4785991310,2cyclictest0-21swapper/222:56:092
4785991310,2cyclictest0-21swapper/222:40:172
4785991310,2cyclictest0-21swapper/222:35:232
4785991310,2cyclictest0-21swapper/222:21:332
4785991310,2cyclictest0-21swapper/220:10:372
4785991310,2cyclictest0-21swapper/219:45:172
4785991310,2cyclictest0-21swapper/219:41:032
4785991310,2cyclictest0-21swapper/219:35:162
478599130,2cyclictest0-21swapper/222:30:592
478599130,2cyclictest0-21swapper/221:26:012
478599130,2cyclictest0-21swapper/221:01:022
478599130,2cyclictest0-21swapper/220:31:002
478599130,2cyclictest0-21swapper/219:50:172
478599130,12cyclictest12-21rcu_preempt23:53:512
478599130,12cyclictest0-21swapper/222:51:562
478599130,12cyclictest0-21swapper/200:11:052
478599130,11cyclictest0-21swapper/221:55:172
478499139,2cyclictest0-21swapper/123:20:151
478499138,3cyclictest0-21swapper/120:00:001
478499131,11cyclictest0-21swapper/122:04:061
4784991310,2cyclictest0-21swapper/123:45:311
4784991310,2cyclictest0-21swapper/123:10:441
4784991310,2cyclictest0-21swapper/121:44:071
4784991310,2cyclictest0-21swapper/100:32:411
4784991310,2cyclictest0-21swapper/100:09:271
478499130,4cyclictest0-21swapper/120:26:051
478499130,3cyclictest0-21swapper/123:26:051
478499130,2cyclictest0-21swapper/123:42:081
478499130,2cyclictest0-21swapper/121:55:181
478499130,1cyclictest0-21swapper/122:35:481
478499130,12cyclictest0-21swapper/121:25:111
478499130,12cyclictest0-21swapper/121:13:571
478499130,12cyclictest0-21swapper/100:00:111
4783991310,2cyclictest3210-21kworker/u8:100:22:040
4783991310,2cyclictest20870-21diskmemload23:10:080
4783991310,2cyclictest0-21swapper/023:58:580
4783991310,2cyclictest0-21swapper/023:45:110
4783991310,2cyclictest0-21swapper/023:03:210
4783991310,2cyclictest0-21swapper/022:22:550
4783991310,2cyclictest0-21swapper/021:28:090
4783991310,2cyclictest0-21swapper/020:50:190
4783991310,2cyclictest0-21swapper/020:30:170
4783991310,2cyclictest0-21swapper/019:45:150
4783991310,2cyclictest0-21swapper/019:35:150
4783991310,2cyclictest0-21swapper/019:10:170
478399130,2cyclictest0-21swapper/021:03:170
478399130,2cyclictest0-21swapper/000:13:560
478399130,12cyclictest0-21swapper/022:03:280
478399130,12cyclictest0-21swapper/021:13:470
478399130,12cyclictest0-21swapper/020:46:030
478399130,12cyclictest0-21swapper/020:46:020
478399130,12cyclictest0-21swapper/000:35:230
169612130,2sleep00-21swapper/021:37:590
478699129,2cyclictest21314-21ssh23:52:283
478699129,2cyclictest13034-21apt-get20:50:113
478699129,2cyclictest0-21swapper/323:16:133
478699129,2cyclictest0-21swapper/321:12:213
478699129,2cyclictest0-21swapper/320:34:343
478699129,2cyclictest0-21swapper/319:23:183
478699129,2cyclictest0-21swapper/319:10:133
478699127,3cyclictest11223-21aten2.4-expect22:05:113
478699122,6cyclictest0-21swapper/321:16:023
478699121,9cyclictest24382-21sendmail-mta23:23:583
478699120,2cyclictest0-21swapper/323:10:243
478699120,2cyclictest0-21swapper/323:00:123
478699120,2cyclictest0-21swapper/321:53:283
478699120,11cyclictest0-21swapper/322:45:323
478699120,11cyclictest0-21swapper/322:27:033
478699120,11cyclictest0-21swapper/322:00:083
478699120,11cyclictest0-21swapper/320:15:153
478699120,11cyclictest0-21swapper/300:23:383
478699120,11cyclictest0-21swapper/300:13:463
478699120,10cyclictest0-21swapper/322:22:233
478599129,2cyclictest0-21swapper/221:20:272
478599129,2cyclictest0-21swapper/220:41:012
478599129,2cyclictest0-21swapper/220:35:132
478599129,2cyclictest0-21swapper/219:25:192
478599128,3cyclictest27319-21kworker/u8:220:15:042
478599120,2cyclictest0-21swapper/223:45:052
478599120,2cyclictest0-21swapper/223:05:142
478499129,2cyclictest23-21ksoftirqd/123:02:031
478499129,2cyclictest0-21swapper/121:33:091
478499129,2cyclictest0-21swapper/120:55:511
478499129,2cyclictest0-21swapper/120:06:071
478499129,2cyclictest0-21swapper/100:20:201
478499122,7cyclictest0-21swapper/119:45:011
478499120,2cyclictest0-21swapper/123:07:031
478499120,2cyclictest0-21swapper/120:35:191
478499120,10cyclictest0-21swapper/119:30:181
478499120,10cyclictest0-21swapper/100:15:211
478399129,2cyclictest2696-21kworker/u8:119:25:050
478399129,2cyclictest0-21swapper/020:40:180
478399129,2cyclictest0-21swapper/020:10:130
478399129,2cyclictest0-21swapper/019:41:040
478399129,2cyclictest0-21swapper/000:05:050
478399120,2cyclictest0-21swapper/023:35:010
478399120,2cyclictest0-21swapper/019:50:180
478399120,11cyclictest32606-21ssh21:20:540
478399120,11cyclictest0-21swapper/022:42:240
478399120,11cyclictest0-21swapper/020:20:180
115042120,1sleep211505-21fschecks_time20:45:142
115042120,1sleep211505-21fschecks_time20:45:132
87502110,1sleep3381ktimersoftd/321:30:103
478699118,2cyclictest0-21swapper/323:05:543
478699118,2cyclictest0-21swapper/320:55:123
478699118,2cyclictest0-21swapper/320:23:373
478699112,6cyclictest0-21swapper/319:54:583
478699112,6cyclictest0-21swapper/319:16:583
478699111,6cyclictest0-21swapper/300:05:153
478699110,10cyclictest0-21swapper/323:47:473
478599118,2cyclictest12808-21kworker/u8:019:30:042
478599118,2cyclictest0-21swapper/220:01:052
478599118,2cyclictest0-21swapper/219:13:342
478599110,10cyclictest0-21swapper/221:05:552
478499118,2cyclictest0-21swapper/120:24:081
478499118,2cyclictest0-21swapper/120:00:121
478499112,7cyclictest0-21swapper/119:17:011
478499110,3cyclictest13401-21grep20:50:131
478499110,10cyclictest0-21swapper/120:45:401
478499110,10cyclictest0-21swapper/120:45:391
478399111,8cyclictest2881-21aten2.4_r3power20:25:100
478399111,3cyclictest31643-21cut20:15:140
478399111,3cyclictest15041-21apt-get20:55:090
478399110,3cyclictest7955-21processes19:15:180
478399110,2cyclictest0-21swapper/021:05:240
164862110,1sleep30-21swapper/322:42:303
478699107,2cyclictest0-21swapper/321:04:423
478699107,2cyclictest0-21swapper/319:55:173
478699105,3cyclictest9305-21cpuspeed_turbos20:40:133
478699102,7cyclictest0-21swapper/320:14:023
478699102,5cyclictest0-21swapper/320:47:583
478699102,5cyclictest0-21swapper/320:47:583
478699101,7cyclictest17533-21cut19:40:143
478599107,2cyclictest24659-21kworker/u8:119:59:042
478599107,2cyclictest0-21swapper/219:15:122
478599100,1cyclictest0-21swapper/220:54:252
478499105,3cyclictest9034-21munin-node1
478499102,7cyclictest0-21swapper/120:16:021
478499101,8cyclictest12-21rcu_preempt20:10:131
478499100,2cyclictest0-21swapper/120:34:101
478399107,2cyclictest0-21swapper/020:35:120
47869994,3cyclictest26797-21sshd20:02:323
47869994,3cyclictest19295-21cpu19:45:153
47869990,7cyclictest0-21swapper/321:08:203
47859996,2cyclictest0-21swapper/220:05:352
47859990,8cyclictest0-21swapper/220:22:272
47839990,8cyclictest0-21swapper/019:30:030
47839990,8cyclictest0-21swapper/019:23:530
47839990,2cyclictest0-21swapper/020:05:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional