You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 06:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Thu Jan 01, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9738212194,20sleep20-21swapper/219:05:212
10326211995,19sleep10-21swapper/119:07:321
10179211896,17sleep00-21swapper/019:05:390
9747210997,6sleep30-21swapper/319:05:213
143842780,0sleep00-21swapper/000:39:290
27542260,0sleep00-21swapper/022:33:460
229132250,0sleep00-21swapper/023:33:220
1054599251,22cyclictest0-21swapper/021:20:140
1054799210,19cyclictest0-21swapper/222:10:122
1054599210,19cyclictest0-21swapper/019:20:000
141032200,0sleep20-21swapper/200:38:592
10545992011,7cyclictest0-21swapper/023:59:110
1054599200,18cyclictest0-21swapper/022:01:200
1054599200,18cyclictest0-21swapper/021:58:030
49912190,1sleep00-21swapper/023:50:140
34072190,1sleep10-21swapper/100:25:461
10547991916,2cyclictest27001-21kworker/u8:121:22:042
10547991916,2cyclictest16876-21kworker/u8:219:28:052
1054599190,18cyclictest0-21swapper/000:34:290
1054599190,18cyclictest0-21swapper/000:18:290
1054599190,17cyclictest9104-21ssh21:25:310
1054599190,17cyclictest0-21swapper/023:41:210
1054599190,17cyclictest0-21swapper/023:02:110
1054599190,17cyclictest0-21swapper/022:22:350
1054599190,17cyclictest0-21swapper/021:49:500
1054599190,17cyclictest0-21swapper/020:55:150
1054599190,17cyclictest0-21swapper/000:14:300
10547991815,2cyclictest30407-21kworker/u8:120:31:052
10547991815,2cyclictest30407-21kworker/u8:120:18:052
10547991815,2cyclictest27926-21kworker/u8:219:53:052
10547991815,2cyclictest27001-21kworker/u8:121:14:042
10547991815,2cyclictest25784-21kworker/u8:019:19:052
10547991815,2cyclictest24890-21kworker/u8:000:17:032
10547991815,2cyclictest21309-21kworker/u8:222:34:052
10547991815,2cyclictest18891-21kworker/u8:119:34:042
10547991815,2cyclictest18891-21kworker/u8:119:23:042
10547991815,2cyclictest17114-21kworker/u8:123:03:032
10547991815,2cyclictest10812-21kworker/u8:021:34:052
1054599189,8cyclictest0-21swapper/022:35:410
1054599180,7cyclictest6675-21snmpd22:56:510
1054599180,7cyclictest0-21swapper/023:22:220
1054599180,7cyclictest0-21swapper/020:00:130
1054599180,7cyclictest0-21swapper/000:21:010
1054599180,17cyclictest0-21swapper/022:53:330
1054599180,16cyclictest32703-21munin-node0
1054599180,16cyclictest26662-21diskmemload00:02:070
1054599180,16cyclictest0-21swapper/023:48:260
10547991714,2cyclictest6689-21kworker/u8:220:28:042
10547991714,2cyclictest503-21kworker/u8:020:06:052
10547991714,2cyclictest32016-21kworker/u8:122:40:042
10547991714,2cyclictest30407-21kworker/u8:120:43:052
10547991714,2cyclictest30407-21kworker/u8:119:59:042
10547991714,2cyclictest18863-21kworker/u8:220:55:032
10547991714,2cyclictest16876-21kworker/u8:219:39:042
10547991714,2cyclictest11020-21kworker/u8:323:23:052
10547991714,2cyclictest10812-21kworker/u8:020:39:042
10547991714,2cyclictest0-21swapper/220:20:112
1054699171,2cyclictest328750irq/24-eth122:29:041
1054599179,7cyclictest0-21swapper/022:15:120
1054599176,9cyclictest26662-21diskmemload22:08:300
1054599170,7cyclictest0-21swapper/023:35:460
1054599170,7cyclictest0-21swapper/023:18:020
1054599170,16cyclictest0-21swapper/023:06:140
1054599170,16cyclictest0-21swapper/022:13:360
1054599170,16cyclictest0-21swapper/021:51:250
1054599170,16cyclictest0-21swapper/020:20:180
1054599170,15cyclictest0-21swapper/000:25:560
316922160,1sleep331695-21unixbench_singl23:05:323
10549991612,2cyclictest21309-21kworker/u8:222:29:043
10547991613,2cyclictest9091-21kworker/u8:122:21:052
10547991613,2cyclictest9091-21kworker/u8:122:09:052
10547991613,2cyclictest5295-21kworker/u8:022:47:042
10547991613,2cyclictest4693-21kworker/u8:123:27:032
10547991613,2cyclictest4693-21kworker/u8:123:19:042
10547991613,2cyclictest4325-21kworker/u8:200:08:042
10547991613,2cyclictest3429-21kworker/u8:022:02:042
10547991613,2cyclictest30407-21kworker/u8:120:11:042
10547991613,2cyclictest30407-21kworker/u8:120:02:042
10547991613,2cyclictest30269-21kworker/u8:023:48:052
10547991613,2cyclictest27001-21kworker/u8:121:17:052
10547991613,2cyclictest26543-21kworker/u8:022:25:042
10547991613,2cyclictest24886-21kworker/u8:019:46:042
10547991613,2cyclictest18891-21kworker/u8:119:13:042
10547991613,2cyclictest18863-21kworker/u8:221:09:052
10547991613,2cyclictest18863-21kworker/u8:220:54:052
10547991613,2cyclictest17114-21kworker/u8:122:55:042
10547991613,2cyclictest10812-21kworker/u8:021:01:042
1054799161,13cyclictest20432-21ssh21:40:062
1054599169,6cyclictest0-21swapper/022:42:010
1054599165,9cyclictest18611-21latency_hist20:50:010
1054599164,10cyclictest178892sleep021:35:510
1054599162,11cyclictest0-21swapper/019:32:020
1054599160,6cyclictest0-21swapper/021:42:040
1054599160,15cyclictest0-21swapper/023:26:400
1054599160,15cyclictest0-21swapper/023:11:510
1054599160,15cyclictest0-21swapper/020:41:110
1054599160,14cyclictest0-21swapper/022:49:150
1054599160,14cyclictest0-21swapper/021:00:120
10549991511,2cyclictest3195-21iostat20:10:183
1054999150,2cyclictest26662-21diskmemload00:13:433
1054999150,13cyclictest18827-21sh21:37:343
1054999150,13cyclictest0-21swapper/300:02:163
10547991512,2cyclictest4693-21kworker/u8:123:56:052
10547991512,2cyclictest24890-21kworker/u8:000:27:032
10547991512,2cyclictest21309-21kworker/u8:222:18:042
10547991512,2cyclictest16280-21kworker/u8:121:39:042
1054799151,12cyclictest0-21swapper/221:52:592
1054699155,3cyclictest22631-21latency_hist21:00:011
1054699151,12cyclictest9602-21df23:55:111
1054699151,12cyclictest0-21swapper/122:30:201
1054699151,12cyclictest0-21swapper/122:10:241
1054699150,13cyclictest15766-21sed23:25:131
1054699150,13cyclictest12680-21munin-node1
1054699150,13cyclictest0-21swapper/122:15:021
1054599157,7cyclictest0-21swapper/000:06:310
1054599154,9cyclictest29197-21ssh22:25:470
1054599154,9cyclictest27812-21missed_timers21:10:160
1054599154,9cyclictest26662-21diskmemload21:30:080
1054599150,5cyclictest22669-21copy19:40:030
10549991411,2cyclictest0-21swapper/323:43:493
10549991411,2cyclictest0-21swapper/323:28:433
10549991411,2cyclictest0-21swapper/323:22:043
10549991411,2cyclictest0-21swapper/322:35:173
10549991411,2cyclictest0-21swapper/322:17:443
10549991411,2cyclictest0-21swapper/321:57:033
10549991411,2cyclictest0-21swapper/321:18:033
10549991411,2cyclictest0-21swapper/300:27:483
1054999140,3cyclictest31803-21sh21:52:353
1054999140,2cyclictest0-21swapper/322:24:443
1054999140,2cyclictest0-21swapper/321:44:443
1054999140,2cyclictest0-21swapper/319:15:133
1054999140,13cyclictest0-21swapper/323:30:343
1054999140,13cyclictest0-21swapper/322:10:433
1054999140,13cyclictest0-21swapper/321:26:233
1054999140,13cyclictest0-21swapper/321:24:523
1054999140,12cyclictest26662-21diskmemload00:38:393
1054999140,12cyclictest0-21swapper/322:50:163
1054999140,12cyclictest0-21swapper/322:05:103
1054999140,12cyclictest0-21swapper/322:04:263
1054999140,12cyclictest0-21swapper/321:45:043
1054999140,12cyclictest0-21swapper/321:13:073
1054999140,12cyclictest0-21swapper/319:45:263
1054999140,12cyclictest0-21swapper/300:16:163
10547991411,2cyclictest4693-21kworker/u8:123:40:042
10547991411,2cyclictest4693-21kworker/u8:100:03:032
10547991411,2cyclictest32274-21kworker/u8:200:31:042
10547991411,2cyclictest11817-21kworker/u8:221:46:042
1054799140,3cyclictest7467-21munin-node2
1054799140,12cyclictest23497-21sed19:40:282
1054799140,12cyclictest0-21swapper/223:52:592
1054799140,12cyclictest0-21swapper/223:35:122
10546991411,2cyclictest10812-21kworker/u8:021:26:041
10546991411,2cyclictest0-21swapper/121:35:141
1054699140,3cyclictest19845-21cut20:50:211
1054699140,13cyclictest0-21swapper/120:00:141
1054699140,12cyclictest0-21swapper/120:25:201
1054599144,8cyclictest7458-21runrttasks19:35:530
1054599144,8cyclictest19543-21latency20:50:160
1054599143,9cyclictest7458-21runrttasks20:10:470
1054599143,9cyclictest6431-21nscd20:15:120
1054599143,9cyclictest25138-21cpuspeed_turbos21:05:140
1054599143,9cyclictest15726-21chrt19:20:200
1054599143,9cyclictest1407-21ntpq20:05:180
1054599143,9cyclictest11502-21wc19:10:160
1054599143,9cyclictest104362sleep020:28:390
1054599142,10cyclictest16813-21runrttasks19:25:120
1054599141,11cyclictest7458-21runrttasks19:45:110
3282130,2sleep10-21swapper/123:45:081
321762130,2sleep126662-21diskmemload23:44:231
1054999131,2cyclictest0-21swapper/322:41:253
10549991310,2cyclictest19558-21ssh00:07:593
10549991310,2cyclictest0-21swapper/323:55:263
10549991310,2cyclictest0-21swapper/323:54:293
10549991310,2cyclictest0-21swapper/323:35:543
10549991310,2cyclictest0-21swapper/323:10:133
10549991310,2cyclictest0-21swapper/323:00:143
10549991310,2cyclictest0-21swapper/322:48:033
10549991310,2cyclictest0-21swapper/322:30:383
10549991310,2cyclictest0-21swapper/321:32:483
10549991310,2cyclictest0-21swapper/320:00:273
10549991310,2cyclictest0-21swapper/319:30:183
10549991310,2cyclictest0-21swapper/319:25:133
10549991310,2cyclictest0-21swapper/300:30:153
1054999130,3cyclictest7724-21awk23:15:213
1054999130,2cyclictest0-21swapper/323:45:283
1054999130,2cyclictest0-21swapper/320:45:193
1054999130,2cyclictest0-21swapper/320:35:163
1054999130,12cyclictest0-21swapper/320:55:233
1054999130,12cyclictest0-21swapper/320:15:143
1054999130,12cyclictest0-21swapper/300:21:363
1054999130,11cyclictest27286-21df_inode19:50:123
10547991310,2cyclictest5295-21kworker/u8:022:50:042
10547991310,2cyclictest0-21swapper/223:06:172
1054799130,2cyclictest0-21swapper/223:31:212
1054799130,12cyclictest0-21swapper/223:10:012
1054799130,12cyclictest0-21swapper/222:35:352
1054799130,12cyclictest0-21swapper/221:55:412
1054799130,12cyclictest0-21swapper/200:20:202
1054699138,4cyclictest0-21swapper/100:15:141
1054699131,3cyclictest0-21swapper/120:45:141
10546991310,2cyclictest0-21swapper/119:55:131
1054699130,2cyclictest26662-21diskmemload23:16:341
1054699130,12cyclictest0-21swapper/121:45:131
1054699130,12cyclictest0-21swapper/121:22:241
1054699130,11cyclictest0-21swapper/122:55:051
1054599131,10cyclictest6025-21avahi-daemon19:55:120
1054599131,10cyclictest26908-21cut19:50:090
1054599131,10cyclictest12797-21aten2.4_r3power20:35:140
1054599131,10cyclictest10922-21aten2.4_r3power20:30:130
249992120,3sleep10-21swapper/121:05:151
1054999120,2cyclictest0-21swapper/322:56:463
1054999120,2cyclictest0-21swapper/319:40:223
1054799120,11cyclictest0-21swapper/200:11:082
1054699129,2cyclictest26662-21diskmemload23:10:271
1054699129,2cyclictest0-21swapper/122:50:131
1054699129,2cyclictest0-21swapper/122:44:461
1054699129,2cyclictest0-21swapper/121:53:201
1054699129,2cyclictest0-21swapper/121:40:091
1054699129,2cyclictest0-21swapper/119:50:221
1054699129,2cyclictest0-21swapper/100:00:261
1054699127,4cyclictest0-21swapper/100:31:111
1054699121,9cyclictest20960-21apt-get00:10:091
1054699121,3cyclictest24889-21munin-node1
1054699120,2cyclictest26662-21diskmemload21:31:101
1054699120,2cyclictest0-21swapper/123:02:011
1054699120,2cyclictest0-21swapper/122:02:251
1054699120,2cyclictest0-21swapper/100:20:061
1054699120,11cyclictest0-21swapper/123:51:251
1054699120,11cyclictest0-21swapper/123:30:401
1054699120,11cyclictest0-21swapper/123:05:271
1054699120,11cyclictest0-21swapper/122:38:141
1054699120,11cyclictest0-21swapper/121:10:211
1054699120,10cyclictest1992-21sh21:55:201
1054999118,2cyclictest0-21swapper/321:05:183
1054999118,2cyclictest0-21swapper/320:20:163
1054999118,2cyclictest0-21swapper/319:35:183
1054799112,6cyclictest0-21swapper/220:45:582
1054699119,1cyclictest0-21swapper/119:20:201
1054699118,2cyclictest0-21swapper/120:40:241
1054699117,2cyclictest0-21swapper/100:35:161
1054699111,9cyclictest0-21swapper/120:35:171
1054699111,8cyclictest0-21swapper/121:15:241
1054699111,8cyclictest0-21swapper/119:35:181
1054699111,3cyclictest0-21swapper/119:30:171
1054699111,3cyclictest0-21swapper/119:10:171
1054699110,9cyclictest0-21swapper/123:35:221
1054699110,9cyclictest0-21swapper/120:15:161
1054699110,9cyclictest0-21swapper/120:05:151
1054699110,2cyclictest26662-21diskmemload22:21:341
1054699110,2cyclictest0-21swapper/119:25:241
1054699110,10cyclictest6689-21kworker/u8:220:22:041
1054699110,10cyclictest0-21swapper/122:05:231
1054699110,10cyclictest0-21swapper/119:40:341
1054699107,2cyclictest0-21swapper/100:07:251
1054699106,2cyclictest0-21swapper/120:30:121
1054699101,8cyclictest0-21swapper/123:20:131
1054699101,7cyclictest0-21swapper/120:10:201
1054699100,3cyclictest22860-21munin-node1
105499996,2cyclictest0-21swapper/320:40:143
105499996,2cyclictest0-21swapper/320:05:393
105499996,2cyclictest0-21swapper/319:55:173
105499992,2cyclictest27750jbd2/sda1-820:50:203
105469994,3cyclictest13033-21tr19:15:121
105499985,2cyclictest0-21swapper/319:10:123
105499984,3cyclictest23580-21runrttasks21:00:173
105499983,3cyclictest10802-21aten2.4_r3power20:30:113
105499980,7cyclictest0-21swapper/319:24:393
105499970,3cyclictest8906-21aten2.4_r3power20:25:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional