You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 12:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Nov 26, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4739211996,17sleep20-21swapper/219:08:222
4838211894,19sleep00-21swapper/019:09:310
4804211395,12sleep10-21swapper/119:09:091
4597211395,13sleep30-21swapper/319:06:393
320782760,0sleep00-21swapper/023:00:260
89242750,0sleep1221ktimersoftd/123:10:171
154262700,0sleep00-21swapper/023:16:530
273242680,0sleep10-21swapper/100:03:081
59612570,1sleep10-21swapper/123:07:071
93522430,1sleep39354-21aten2.4_r3power19:20:123
490599350,17cyclictest0-21swapper/121:10:131
4905993214,16cyclictest0-21swapper/120:55:111
63432270,1sleep06344-21mailstats20:30:230
141722220,1sleep0101ktimersoftd/019:30:180
490599210,2cyclictest0-21swapper/119:30:131
4907991910,2cyclictest21167-21diskmemload22:20:153
490799190,2cyclictest0-21swapper/321:25:273
490799190,2cyclictest0-21swapper/321:10:133
4906991916,2cyclictest2811-21kworker/u8:200:29:052
490799189,2cyclictest0-21swapper/323:33:373
490799189,2cyclictest0-21swapper/321:47:473
490799189,2cyclictest0-21swapper/300:17:373
490799189,2cyclictest0-21swapper/300:14:193
490799182,6cyclictest0-21swapper/300:35:253
490799180,2cyclictest0-21swapper/323:15:083
490799180,2cyclictest0-21swapper/321:18:593
490799180,2cyclictest0-21swapper/319:25:173
490799180,11cyclictest21167-21diskmemload22:19:163
490799180,11cyclictest0-21swapper/323:52:383
4906991815,2cyclictest7213-21kworker/u8:122:02:052
490499180,2cyclictest0-21swapper/021:30:130
490799179,2cyclictest0-21swapper/322:09:293
490799179,2cyclictest0-21swapper/322:09:283
490799179,2cyclictest0-21swapper/300:25:273
490799179,2cyclictest0-21swapper/300:01:273
490799178,2cyclictest0-21swapper/323:13:593
490799177,2cyclictest31567-21aten2.4_r3power20:15:133
490799170,2cyclictest0-21swapper/321:36:373
490799170,11cyclictest0-21swapper/322:44:173
490799170,11cyclictest0-21swapper/300:31:063
490799170,10cyclictest0-21swapper/321:24:283
4906991714,2cyclictest31149-21kworker/u8:121:29:042
4906991714,2cyclictest29599-21kworker/u8:123:32:052
4905991712,3cyclictest12964-21munin-run21:35:001
490799168,2cyclictest0-21swapper/321:33:273
490799160,9cyclictest21800-21fschecks_count19:50:143
490799160,9cyclictest0-21swapper/321:00:203
490799160,10cyclictest0-21swapper/321:50:203
490699163,2cyclictest0-21swapper/221:50:052
4906991613,2cyclictest19198-21kworker/u8:122:49:052
4906991613,2cyclictest1435-21kworker/u8:321:32:042
490699161,13cyclictest6341-21telnet00:15:132
490699160,14cyclictest0-21swapper/220:44:592
490599161,13cyclictest0-21swapper/123:40:021
490599161,13cyclictest0-21swapper/122:37:191
490599160,14cyclictest17689-21sort22:45:251
490499160,3cyclictest31470-21sh20:15:050
490799151,5cyclictest0-21swapper/323:00:013
490699151,3cyclictest0-21swapper/221:20:162
490699151,3cyclictest0-21swapper/220:55:172
4906991512,2cyclictest8495-21kworker/u8:023:49:052
4906991512,2cyclictest7213-21kworker/u8:122:06:062
4906991512,2cyclictest7213-21kworker/u8:122:06:062
4906991512,2cyclictest4650-21kworker/u8:020:29:052
4906991512,2cyclictest31149-21kworker/u8:121:46:052
4906991512,2cyclictest25645-21kworker/u8:200:36:062
4906991512,2cyclictest22056-21kworker/u8:119:27:052
4906991512,2cyclictest21487-21kworker/u8:019:59:042
4906991512,2cyclictest14051-21kworker/u8:000:24:052
4906991512,2cyclictest11809-21kworker/u8:023:17:042
4906991512,2cyclictest0-21swapper/221:40:122
4906991511,2cyclictest885-21ssh23:35:202
490699150,13cyclictest7352-21ssh23:09:192
490599159,4cyclictest0-21swapper/121:50:511
490599155,7cyclictest5911-21gdm-simple-gree22:34:591
490599151,3cyclictest0-21swapper/123:23:561
490599151,2cyclictest21167-21diskmemload22:19:541
4905991510,3cyclictest9844-21grep19:20:151
490599150,3cyclictest0-21swapper/121:59:541
490599150,13cyclictest21167-21diskmemload23:01:251
4904991512,2cyclictest21167-21diskmemload23:50:250
490499151,12cyclictest5145-21ssh00:13:590
4904991510,3cyclictest0-21swapper/019:40:150
490799149,3cyclictest0-21swapper/320:10:223
490799141,5cyclictest0-21swapper/319:35:013
490699149,3cyclictest1319-21ssh23:02:402
490699149,3cyclictest0-21swapper/223:59:112
4906991411,2cyclictest7279-21apt-get20:35:132
4906991411,2cyclictest6997-21kworker/u8:221:00:052
4906991411,2cyclictest26861-21kworker/u8:120:11:052
4906991411,2cyclictest14003-21kworker/u8:019:32:042
4906991411,2cyclictest0-21swapper/222:30:002
490699140,2cyclictest0-21swapper/200:01:302
490699140,13cyclictest0-21swapper/223:41:592
490699140,13cyclictest0-21swapper/222:21:002
490699140,13cyclictest0-21swapper/220:15:202
490699140,12cyclictest0-21swapper/200:13:102
4905991411,2cyclictest0-21swapper/123:30:441
4905991411,2cyclictest0-21swapper/122:25:351
4905991411,2cyclictest0-21swapper/121:16:401
4905991411,2cyclictest0-21swapper/100:35:271
490599140,3cyclictest15907-21sh23:17:391
490599140,2cyclictest21167-21diskmemload21:39:551
490599140,2cyclictest0-21swapper/122:07:151
490599140,2cyclictest0-21swapper/122:07:141
490599140,2cyclictest0-21swapper/100:15:551
490599140,13cyclictest0-21swapper/123:51:351
490599140,13cyclictest0-21swapper/122:12:251
490599140,13cyclictest0-21swapper/121:42:451
490599140,13cyclictest0-21swapper/100:05:541
490599140,12cyclictest332250irq/24-eth119:55:161
490599140,12cyclictest0-21swapper/123:25:131
490599140,12cyclictest0-21swapper/122:50:501
490599140,12cyclictest0-21swapper/120:50:261
490599140,12cyclictest0-21swapper/100:11:031
4904991411,2cyclictest0-21swapper/022:54:450
490499140,13cyclictest26099-21ssh21:47:540
490499140,13cyclictest0-21swapper/020:00:150
490499140,12cyclictest25331-21ssh22:20:180
490499140,12cyclictest0-21swapper/022:27:590
490499140,12cyclictest0-21swapper/022:05:260
490499140,12cyclictest0-21swapper/022:05:250
490499140,12cyclictest0-21swapper/021:21:560
490499140,12cyclictest0-21swapper/020:05:250
98842130,2sleep00-21swapper/022:38:020
67772130,2sleep00-21swapper/023:41:070
4907991310,2cyclictest0-21swapper/323:35:193
4907991310,2cyclictest0-21swapper/323:20:283
4907991310,2cyclictest0-21swapper/321:41:383
490799130,2cyclictest32058-21ssh23:00:263
490799130,2cyclictest0-21swapper/323:08:573
490799130,2cyclictest0-21swapper/322:10:193
490799130,12cyclictest0-21swapper/322:50:273
490799130,12cyclictest0-21swapper/322:25:173
490799130,11cyclictest0-21swapper/322:33:383
4906991310,2cyclictest29599-21kworker/u8:123:20:052
4906991310,2cyclictest22056-21kworker/u8:119:48:042
4906991310,2cyclictest21167-21diskmemload22:35:302
4906991310,2cyclictest17400-21kworker/u8:121:09:032
4906991310,2cyclictest15378-21kworker/u8:219:39:052
4906991310,2cyclictest14003-21kworker/u8:019:18:002
4906991310,2cyclictest11351-21kworker/u8:020:54:052
4906991310,2cyclictest11351-21kworker/u8:020:47:052
4906991310,2cyclictest0-21swapper/222:59:102
490699130,8cyclictest0-21swapper/219:41:032
490699130,2cyclictest21167-21diskmemload22:10:212
490699130,2cyclictest0-21swapper/222:52:022
490699130,2cyclictest0-21swapper/221:13:022
490699130,2cyclictest0-21swapper/200:31:042
490699130,12cyclictest0-21swapper/223:10:212
4905991310,2cyclictest21167-21diskmemload23:59:231
4905991310,2cyclictest0-21swapper/123:47:211
4905991310,2cyclictest0-21swapper/123:36:101
4905991310,2cyclictest0-21swapper/122:01:191
4905991310,2cyclictest0-21swapper/121:45:121
4905991310,2cyclictest0-21swapper/120:25:141
4905991310,2cyclictest0-21swapper/119:50:261
4905991310,2cyclictest0-21swapper/119:40:171
490599130,2cyclictest0-21swapper/122:55:531
490599130,2cyclictest0-21swapper/122:24:031
490599130,2cyclictest0-21swapper/121:29:201
490599130,2cyclictest0-21swapper/120:20:161
490599130,2cyclictest0-21swapper/100:25:341
490599130,12cyclictest21167-21diskmemload21:23:231
490599130,12cyclictest0-21swapper/100:20:011
490599130,11cyclictest0-21swapper/100:30:171
4904991310,2cyclictest21167-21diskmemload21:18:250
4904991310,2cyclictest0-21swapper/022:42:560
4904991310,2cyclictest0-21swapper/022:10:120
4904991310,2cyclictest0-21swapper/021:55:250
4904991310,2cyclictest0-21swapper/021:41:450
4904991310,2cyclictest0-21swapper/021:35:450
4904991310,2cyclictest0-21swapper/000:34:080
4904991310,2cyclictest0-21swapper/000:26:550
4904991310,2cyclictest0-21swapper/000:20:130
4904991310,2cyclictest0-21swapper/000:05:270
4904991310,2cyclictest0-21swapper/000:02:320
490499130,2cyclictest7961-21ssh00:15:430
490499130,2cyclictest0-21swapper/023:27:250
490499130,2cyclictest0-21swapper/022:45:140
490499130,2cyclictest0-21swapper/022:34:340
490499130,12cyclictest0-21swapper/023:32:140
490499130,12cyclictest0-21swapper/023:14:350
490499130,12cyclictest0-21swapper/022:18:250
490499130,11cyclictest0-21swapper/022:57:180
16142130,2sleep00-21swapper/023:35:500
490799129,2cyclictest0-21swapper/323:47:093
490799129,2cyclictest0-21swapper/321:55:113
490799122,6cyclictest0-21swapper/319:40:233
490799120,2cyclictest0-21swapper/323:25:493
490799120,2cyclictest0-21swapper/322:46:363
490799120,2cyclictest0-21swapper/320:25:193
490799120,11cyclictest0-21swapper/323:59:083
490799120,11cyclictest0-21swapper/322:38:573
490799120,11cyclictest0-21swapper/300:21:073
490799120,11cyclictest0-21swapper/300:06:463
490699129,2cyclictest4650-21kworker/u8:020:30:052
490699129,2cyclictest17264-21kworker/u8:223:25:052
490699129,2cyclictest14003-21kworker/u8:019:20:062
490699129,2cyclictest0-21swapper/222:40:012
490699129,2cyclictest0-21swapper/221:36:112
490699128,2cyclictest5129-21runrttasks00:06:092
490699120,2cyclictest0-21swapper/222:34:052
490699120,1cyclictest0-21swapper/223:52:132
490699120,11cyclictest0-21swapper/222:16:022
490599129,2cyclictest0-21swapper/122:41:021
490599129,2cyclictest0-21swapper/119:35:211
490599129,2cyclictest0-21swapper/119:25:181
490599121,9cyclictest0-21swapper/120:05:151
490599121,3cyclictest0-21swapper/121:05:121
490599121,3cyclictest0-21swapper/119:15:231
490599120,2cyclictest0-21swapper/120:30:191
490599120,1cyclictest0-21swapper/119:45:161
490599120,11cyclictest0-21swapper/120:15:011
490599120,11cyclictest0-21swapper/120:10:161
490599120,11cyclictest0-21swapper/119:10:171
490499129,2cyclictest0-21swapper/023:55:270
490499129,2cyclictest0-21swapper/023:23:550
490499129,2cyclictest0-21swapper/023:05:190
490499129,2cyclictest0-21swapper/022:00:100
490499129,2cyclictest0-21swapper/019:35:140
490499129,2cyclictest0-21swapper/000:35:130
490499120,2cyclictest0-21swapper/023:45:360
490499120,2cyclictest0-21swapper/021:25:130
490499120,2cyclictest0-21swapper/020:10:170
490499120,11cyclictest0-21swapper/021:54:050
490499120,11cyclictest0-21swapper/021:10:370
490499120,11cyclictest0-21swapper/021:00:210
303342120,2sleep20-21swapper/221:19:242
19252120,2sleep20-21swapper/221:55:422
490799118,2cyclictest6573-21ssh23:40:463
490799118,2cyclictest0-21swapper/322:01:083
490799111,5cyclictest0-21swapper/319:15:013
490699118,2cyclictest0-21swapper/219:55:012
490599110,9cyclictest0-21swapper/121:05:001
490599110,9cyclictest0-21swapper/120:00:161
490599110,10cyclictest0-21swapper/120:35:231
490799101,5cyclictest0-21swapper/321:00:003
490799101,5cyclictest0-21swapper/320:05:013
490799101,5cyclictest0-21swapper/319:20:013
490699107,2cyclictest1049-21kworker/u8:220:20:042
490699100,2cyclictest0-21swapper/220:02:012
490599101,7cyclictest0-21swapper/120:40:241
490599100,8cyclictest0-21swapper/120:45:131
490499107,2cyclictest0-21swapper/020:20:120
490499107,2cyclictest0-21swapper/019:55:220
490499107,2cyclictest0-21swapper/019:14:410
490499100,9cyclictest26861-21kworker/u8:120:45:040
49079994,3cyclictest8130-21needreboot20:35:193
49079994,3cyclictest6498-21sort20:30:263
49079994,3cyclictest5129-21runrttasks19:57:293
49079994,3cyclictest27738-21grep20:05:123
49079994,3cyclictest2426-21unixbench_singl20:20:263
49079994,3cyclictest11225-21cat20:44:593
49079994,3cyclictest0-21swapper/320:49:553
49079991,6cyclictest0-21swapper/321:05:223
49079990,7cyclictest0-21swapper/319:35:203
49069994,3cyclictest6064-21missed_timers19:10:182
49069991,5cyclictest0-21swapper/220:05:092
49049996,2cyclictest0-21swapper/020:50:410
49049996,2cyclictest0-21swapper/019:50:220
49049996,2cyclictest0-21swapper/019:15:120
49049994,2cyclictest0-21swapper/021:07:050
49049994,2cyclictest0-21swapper/020:27:040
49049990,2cyclictest0-21swapper/020:37:170
49079983,3cyclictest19626-21grep19:45:133
49079983,3cyclictest14823-21seq20:51:203
49049985,2cyclictest0-21swapper/019:46:560
49049984,3cyclictest10793-1kworker/0:2H20:45:000
49049983,3cyclictest15566-21cpuspeed_turbos20:55:120
49049980,7cyclictest0-21swapper/019:29:410
49049974,2cyclictest5129-21runrttasks19:20:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional