You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 12:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Dec 18, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31893211793,18sleep10-21swapper/119:06:531
31823211598,12sleep30-21swapper/319:05:583
31468211287,18sleep20-21swapper/219:05:202
32022210897,6sleep00-21swapper/019:08:320
268272760,0sleep20-21swapper/222:00:232
230582730,0sleep30-21swapper/300:31:143
144422670,0sleep20-21swapper/200:20:312
272232530,0sleep10-21swapper/123:19:421
32166994019,3cyclictest16059-21diskmemload21:20:123
32166993010,18cyclictest0-21swapper/300:00:123
118082240,0sleep00-21swapper/000:18:340
3216499233,2cyclictest23-21ksoftirqd/120:35:121
154692220,1sleep315470-21cpu23:05:123
3216699211,2cyclictest0-21swapper/322:00:123
32164992118,2cyclictest0-21swapper/122:20:111
24642210,1sleep30-21swapper/323:28:303
3216599200,2cyclictest0-21swapper/219:35:112
3216499202,13cyclictest0-21swapper/121:37:051
32164992017,2cyclictest0-21swapper/123:25:111
3216499201,2cyclictest0-21swapper/122:00:121
3216699190,2cyclictest0-21swapper/319:45:103
3216499194,2cyclictest0-21swapper/100:33:051
114352190,1sleep20-21swapper/220:55:252
3216499173,2cyclictest0-21swapper/122:11:041
3216499171,14cyclictest12003-21apt-get23:40:111
3216499170,12cyclictest0-21swapper/123:47:041
32163991714,2cyclictest101ktimersoftd/021:38:040
3216399171,3cyclictest0-21swapper/021:10:130
3216399170,15cyclictest0-21swapper/022:55:100
32165991613,2cyclictest370-21kworker/u8:100:06:042
32165991613,2cyclictest28455-21kworker/u8:220:33:042
32165991613,2cyclictest15359-21kworker/u8:223:08:042
3216499162,2cyclictest0-21swapper/123:53:051
32164991613,2cyclictest4155-21kworker/u8:020:54:051
32164991613,2cyclictest28455-21kworker/u8:220:56:051
32164991613,2cyclictest28455-21kworker/u8:220:34:051
32164991613,2cyclictest23193-21kworker/u8:021:56:041
32164991613,2cyclictest18348-21kworker/u8:020:08:051
32164991613,2cyclictest12492-21kworker/u8:100:25:041
3216499161,2cyclictest0-21swapper/123:58:041
3216399161,13cyclictest101ktimersoftd/022:52:570
3216399161,13cyclictest101ktimersoftd/022:25:140
3216699151,3cyclictest32719-21ssh21:29:593
3216699150,2cyclictest0-21swapper/323:50:083
3216699150,2cyclictest0-21swapper/300:12:353
3216699150,13cyclictest2641-21munin-node3
3216699150,13cyclictest25241-21seq22:37:413
3216699150,13cyclictest16693-21fschecks_time23:45:133
3216699150,13cyclictest16059-21diskmemload23:12:163
3216699150,13cyclictest0-21swapper/300:24:353
32165991512,2cyclictest22060-21kworker/u8:123:51:042
32165991512,2cyclictest20413-21kworker/u8:222:40:042
32165991512,2cyclictest14254-21kworker/u8:022:29:052
3216599150,2cyclictest0-21swapper/222:50:172
3216499151,3cyclictest16059-21diskmemload21:30:131
32164991512,2cyclictest7941-21kworker/u8:000:14:041
32164991512,2cyclictest5330-21kworker/u8:019:12:041
32164991512,2cyclictest4155-21kworker/u8:020:45:041
32164991512,2cyclictest3707-21kworker/u8:220:01:041
32164991512,2cyclictest3707-21kworker/u8:219:35:041
32164991512,2cyclictest29559-21kworker/u8:122:05:041
32164991512,2cyclictest2651-21kworker/u8:222:54:051
32164991512,2cyclictest25927-21kworker/u8:119:16:051
32164991512,2cyclictest22410-21kworker/u8:120:25:031
32164991512,2cyclictest14254-21kworker/u8:022:27:041
3216499151,12cyclictest0-21swapper/119:50:151
3216499150,2cyclictest16059-21diskmemload22:30:101
3216499150,2cyclictest0-21swapper/122:42:051
3216499150,2cyclictest0-21swapper/122:38:051
3216499150,13cyclictest0-21swapper/123:39:031
3216499150,13cyclictest0-21swapper/100:06:011
3216499150,10cyclictest0-21swapper/123:10:041
3216399152,7cyclictest0-21swapper/023:30:000
3216399152,7cyclictest0-21swapper/019:45:000
3216399152,7cyclictest0-21swapper/019:20:000
3216399152,12cyclictest9-21ksoftirqd/022:23:190
3216399151,12cyclictest343-21rm22:46:100
32163991511,2cyclictest2438-21ssh21:31:050
3216399151,12cyclictest22924-21sh21:17:080
32163991511,2cyclictest0-21swapper/020:15:270
32163991510,3cyclictest0-21swapper/021:50:150
32163991510,3cyclictest0-21swapper/000:05:390
3216399150,13cyclictest16855-21rm21:49:310
3216399150,13cyclictest16059-21diskmemload21:40:370
3216399150,13cyclictest16059-21diskmemload00:11:320
3216399150,13cyclictest101ktimersoftd/022:05:310
3216699149,3cyclictest25178-21munin-node3
32166991411,2cyclictest0-21swapper/323:44:053
32166991411,2cyclictest0-21swapper/323:22:053
32166991411,2cyclictest0-21swapper/323:15:253
32166991411,2cyclictest0-21swapper/322:05:353
32166991411,2cyclictest0-21swapper/300:18:263
3216699140,2cyclictest16059-21diskmemload22:20:133
3216699140,2cyclictest0-21swapper/322:41:153
3216699140,2cyclictest0-21swapper/322:17:053
3216699140,13cyclictest0-21swapper/322:28:363
3216699140,13cyclictest0-21swapper/321:05:163
3216699140,13cyclictest0-21swapper/321:05:153
3216699140,12cyclictest16059-21diskmemload00:28:463
3216699140,12cyclictest0-21swapper/323:36:143
3216699140,12cyclictest0-21swapper/323:31:423
3216699140,12cyclictest0-21swapper/323:02:193
3216699140,12cyclictest0-21swapper/322:51:203
3216699140,12cyclictest0-21swapper/322:45:123
3216699140,12cyclictest0-21swapper/322:14:193
3216699140,12cyclictest0-21swapper/321:56:363
3216699140,12cyclictest0-21swapper/321:48:453
3216599141,2cyclictest4744-21apt-get21:35:122
32165991411,2cyclictest9287-21kworker/u8:023:12:042
32165991411,2cyclictest8296-21kworker/u8:122:18:042
32165991411,2cyclictest28318-21kworker/u8:121:26:052
32165991411,2cyclictest16497-21kworker/u8:021:23:042
32165991411,2cyclictest11188-21kworker/u8:123:42:052
32165991410,2cyclictest22375-21aten2.4-expect20:05:132
3216599140,12cyclictest1835-21tr22:10:132
32164991411,2cyclictest3707-21kworker/u8:219:49:041
32164991411,2cyclictest328750irq/24-eth121:13:581
32164991411,2cyclictest23193-21kworker/u8:022:16:051
32164991411,2cyclictest22410-21kworker/u8:120:16:051
3216499140,2cyclictest0-21swapper/123:34:041
3216499140,2cyclictest0-21swapper/121:19:051
3216499140,12cyclictest16059-21diskmemload23:08:001
3216499140,12cyclictest16059-21diskmemload00:35:411
3216499140,12cyclictest16059-21diskmemload00:35:401
3216499140,12cyclictest0-21swapper/122:45:451
3216399149,3cyclictest0-21swapper/000:21:340
3216399141,7cyclictest0-21swapper/020:50:000
32163991411,2cyclictest9-21ksoftirqd/000:36:530
32163991411,2cyclictest9-21ksoftirqd/000:36:520
32163991411,2cyclictest11-21rcuc/023:50:260
32163991411,2cyclictest11-21rcuc/023:20:430
32163991411,2cyclictest101ktimersoftd/023:34:100
32163991411,2cyclictest101ktimersoftd/000:30:510
32163991411,2cyclictest0-21swapper/023:55:170
3216399140,3cyclictest7478-21ssh22:15:310
3216399140,12cyclictest16059-21diskmemload22:40:120
3216399140,12cyclictest16059-21diskmemload00:28:240
3216399140,12cyclictest101ktimersoftd/023:42:140
3216399140,12cyclictest101ktimersoftd/022:11:130
3216399140,12cyclictest101ktimersoftd/022:03:470
3216399140,12cyclictest0-21swapper/023:45:160
3216399140,12cyclictest0-21swapper/021:56:290
32166991310,2cyclictest0-21swapper/321:17:063
32166991310,2cyclictest0-21swapper/320:50:253
32166991310,2cyclictest0-21swapper/300:05:283
3216699130,2cyclictest16059-21diskmemload21:31:323
3216699130,2cyclictest0-21swapper/323:55:433
3216699130,2cyclictest0-21swapper/322:55:403
3216699130,2cyclictest0-21swapper/321:14:023
3216699130,2cyclictest0-21swapper/319:25:163
3216699130,12cyclictest0-21swapper/322:30:193
3216699130,12cyclictest0-21swapper/321:52:523
3216699130,12cyclictest0-21swapper/300:38:013
3216699130,12cyclictest0-21swapper/300:38:003
3216699130,11cyclictest0-21swapper/321:41:273
32165991310,2cyclictest28318-21kworker/u8:121:30:042
32165991310,2cyclictest13372-21ssh22:23:502
32165991310,2cyclictest0-21swapper/221:10:462
32165991310,2cyclictest0-21swapper/200:16:062
3216599130,12cyclictest0-21swapper/222:47:162
3216599130,12cyclictest0-21swapper/221:16:052
3216599130,12cyclictest0-21swapper/200:04:172
3216599130,11cyclictest7805-21ssh23:35:052
3216599130,11cyclictest16059-21diskmemload21:45:152
3216599130,11cyclictest16059-21diskmemload00:30:152
3216599130,11cyclictest0-21swapper/200:37:072
3216599130,11cyclictest0-21swapper/200:37:062
3216499135,7cyclictest0-21swapper/100:00:111
32164991310,2cyclictest0-21swapper/122:58:221
32164991310,2cyclictest0-21swapper/121:41:191
32164991310,2cyclictest0-21swapper/100:23:421
3216499130,2cyclictest0-21swapper/119:27:041
3216499130,12cyclictest0-21swapper/120:12:041
3216499130,11cyclictest16059-21diskmemload23:20:261
3216499130,11cyclictest0-21swapper/100:15:131
3216399138,3cyclictest18222-21chrt19:55:100
3216399138,3cyclictest11967-21turbostat19:39:590
3216399133,8cyclictest277-21jbd2/sda1-819:30:220
3216399132,6cyclictest0-21swapper/021:05:010
3216399132,6cyclictest0-21swapper/021:05:000
3216399131,6cyclictest0-21swapper/020:40:000
32163991310,2cyclictest9-21ksoftirqd/021:27:340
32163991310,2cyclictest0-21swapper/023:18:470
32163991310,2cyclictest0-21swapper/023:14:110
32163991310,2cyclictest0-21swapper/023:03:440
32163991310,2cyclictest0-21swapper/000:00:500
3216399130,2cyclictest16059-21diskmemload21:20:100
3216399130,2cyclictest0-21swapper/023:36:260
3216399130,12cyclictest101ktimersoftd/020:50:140
3216399130,12cyclictest0-21swapper/022:35:190
148152130,3sleep20-21swapper/223:04:452
3216699129,2cyclictest0-21swapper/321:35:193
3216699129,2cyclictest0-21swapper/319:20:223
3216699129,2cyclictest0-21swapper/319:15:203
3216699127,3cyclictest12935-21iostat_ios21:00:173
3216699121,7cyclictest28189-21apt-get20:20:013
3216699120,2cyclictest0-21swapper/320:30:173
3216699120,2cyclictest0-21swapper/319:35:103
3216699120,11cyclictest0-21swapper/320:45:243
3216599129,2cyclictest29559-21kworker/u8:122:07:042
3216599129,2cyclictest28455-21kworker/u8:220:35:042
3216599129,2cyclictest16059-21diskmemload21:50:472
3216599129,2cyclictest14254-21kworker/u8:022:35:052
3216599129,2cyclictest0-21swapper/223:31:352
3216599129,2cyclictest0-21swapper/222:30:042
3216599129,2cyclictest0-21swapper/220:00:262
3216599122,7cyclictest0-21swapper/223:45:012
3216599122,7cyclictest0-21swapper/220:16:592
3216599122,7cyclictest0-21swapper/219:46:012
3216599122,7cyclictest0-21swapper/219:17:022
3216599120,2cyclictest16059-21diskmemload21:55:332
3216599120,2cyclictest0-21swapper/220:40:262
3216599120,11cyclictest0-21swapper/223:20:212
3216599120,11cyclictest0-21swapper/223:16:262
3216599120,11cyclictest0-21swapper/221:05:162
3216599120,11cyclictest0-21swapper/221:05:152
3216599120,10cyclictest16059-21diskmemload00:12:022
3216599120,10cyclictest0-21swapper/223:27:422
3216599120,10cyclictest0-21swapper/222:55:502
3216599120,10cyclictest0-21swapper/200:28:422
3216499129,2cyclictest0-21swapper/121:00:181
3216499129,2cyclictest0-21swapper/120:40:201
3216499127,3cyclictest4482-21tune2fs19:20:141
3216499127,3cyclictest12198-21munin-node1
3216499127,3cyclictest0-21swapper/119:55:151
3216499121,9cyclictest17389-21apt-get21:50:101
3216499121,9cyclictest0-21swapper/120:20:121
3216499121,3cyclictest0-21swapper/121:45:581
3216499120,11cyclictest0-21swapper/123:01:181
3216499120,11cyclictest0-21swapper/121:25:201
3216499120,11cyclictest0-21swapper/121:21:571
3216499120,10cyclictest15287-21cut21:05:221
3216499120,10cyclictest15287-21cut21:05:211
3216399129,2cyclictest0-21swapper/019:40:230
3216399129,2cyclictest0-21swapper/019:25:210
3216399127,3cyclictest17301-21ssh23:06:270
3216399122,7cyclictest0-21swapper/020:10:010
3216399121,7cyclictest0-21swapper/019:10:090
3216399120,2cyclictest0-21swapper/020:05:200
3216399120,11cyclictest0-21swapper/022:30:030
3216399120,11cyclictest0-21swapper/021:00:220
3216399120,11cyclictest0-21swapper/020:25:230
3216699118,2cyclictest0-21swapper/320:55:073
3216699118,2cyclictest0-21swapper/320:40:163
3216699118,2cyclictest0-21swapper/319:55:103
3216699118,2cyclictest0-21swapper/319:50:193
3216599118,2cyclictest3707-21kworker/u8:219:42:052
3216599118,2cyclictest22410-21kworker/u8:120:24:042
3216599118,2cyclictest22410-21kworker/u8:120:14:042
3216599118,2cyclictest0-21swapper/223:55:042
3216599112,6cyclictest0-21swapper/221:00:582
3216599110,7cyclictest10294-21ssh21:40:242
3216499111,8cyclictest8165-21munin-node1
3216399118,2cyclictest101ktimersoftd/020:30:230
3216399116,3cyclictest0-21swapper/020:20:060
3216399113,6cyclictest0-21swapper/020:55:240
3216399111,7cyclictest0-21swapper/019:22:580
3216699107,2cyclictest0-21swapper/319:30:163
3216699105,3cyclictest7458-21runrttasks20:00:143
3216699100,9cyclictest0-21swapper/320:27:123
3216599107,2cyclictest3707-21kworker/u8:219:55:042
3216599102,6cyclictest0-21swapper/220:45:222
3216599102,6cyclictest0-21swapper/219:30:232
3216599102,6cyclictest0-21swapper/219:20:232
3216599102,5cyclictest0-21swapper/219:28:592
3216599100,7cyclictest0-21swapper/219:53:022
3216599100,6cyclictest0-21swapper/220:50:232
3216399101,6cyclictest0-21swapper/020:40:120
321669996,2cyclictest7458-21runrttasks19:40:273
321669994,3cyclictest439-21fschecks_time19:10:113
321669994,3cyclictest28657-21cpuspeed_turbos20:20:123
321669994,3cyclictest22941-21if_eth020:05:163
321659994,3cyclictest32627-21tr19:10:082
321659991,6cyclictest0-21swapper/220:25:242
321639994,3cyclictest20357-21aten2.4_r3power20:00:120
321639981,3cyclictest16493-21expr19:50:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional