You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 07:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Fri May 09, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2303121210,0sleep00-21swapper/021:38:250
10390211794,18sleep00-21swapper/019:07:550
10482211597,13sleep30-21swapper/319:09:073
10202211093,12sleep20-21swapper/219:05:292
10401210796,6sleep10-21swapper/119:08:041
3033421040,0sleep20-21swapper/200:29:582
161232780,0sleep20-21swapper/222:04:232
270092610,0sleep00-21swapper/023:53:130
1058099220,20cyclictest0-21swapper/323:15:103
1058099220,20cyclictest0-21swapper/321:25:173
1057899220,18cyclictest0-21swapper/122:05:131
1058099210,2cyclictest0-21swapper/323:10:133
141142200,1sleep30-21swapper/320:35:233
1057799200,2cyclictest0-21swapper/019:50:110
1057799200,18cyclictest0-21swapper/023:15:100
303902190,0sleep00-21swapper/023:24:140
300532190,0sleep30-21swapper/321:12:413
10579991916,2cyclictest14810-21kworker/u8:122:06:042
1057799190,2cyclictest31311-21rm23:25:160
1057799190,2cyclictest0-21swapper/023:55:120
10580991813,3cyclictest29000-21ssh22:50:123
1058099170,15cyclictest0-21swapper/322:00:133
1058099161,13cyclictest31335-21ssh23:57:193
10578991611,3cyclictest0-21swapper/121:11:581
1058099154,3cyclictest23570-21ssh22:10:453
1058099151,12cyclictest4190-21apt-get21:20:063
1058099151,12cyclictest3541-21ssh22:24:313
1058099151,12cyclictest21414-21ssh22:41:283
10580991510,3cyclictest0-21swapper/323:37:273
1057999151,3cyclictest0-21swapper/221:31:242
10579991512,2cyclictest9758-21kworker/u8:223:22:052
10579991512,2cyclictest2523-21kworker/u8:023:53:032
1057999151,12cyclictest25896-21ssh23:19:532
1057999151,12cyclictest0-21swapper/222:42:582
1057999150,2cyclictest0-21swapper/223:35:152
1057999150,2cyclictest0-21swapper/200:02:052
10578991510,3cyclictest21066-21sleep23:19:551
1057899150,3cyclictest0-21swapper/123:25:231
1057899150,2cyclictest0-21swapper/123:14:261
1057899150,13cyclictest0-21swapper/122:55:171
1057899150,13cyclictest0-21swapper/122:41:031
1057899150,13cyclictest0-21swapper/122:24:481
244712140,3sleep30-21swapper/321:40:133
1058099142,7cyclictest26648-21diskmemload21:45:003
1058099142,7cyclictest0-21swapper/321:35:003
1058099142,7cyclictest0-21swapper/321:04:593
1058099141,11cyclictest32350-21df_inode21:15:133
10580991410,2cyclictest0-21swapper/323:43:173
1058099140,3cyclictest28311-21rm22:49:293
1058099140,2cyclictest0-21swapper/300:23:313
1058099140,12cyclictest19622-21ssh23:45:193
1058099140,12cyclictest0-21swapper/322:34:213
1058099140,12cyclictest0-21swapper/322:15:003
1058099140,12cyclictest0-21swapper/320:55:163
1058099140,12cyclictest0-21swapper/300:03:113
10579991411,2cyclictest11806-21ssh22:31:542
1057999140,3cyclictest36422sleep222:24:402
1057999140,3cyclictest0-21swapper/222:47:042
1057999140,2cyclictest26648-21diskmemload00:11:352
1057999140,2cyclictest0-21swapper/223:06:342
1057999140,13cyclictest0-21swapper/223:34:242
1057999140,13cyclictest0-21swapper/223:25:082
1057999140,13cyclictest0-21swapper/221:16:122
1057999140,13cyclictest0-21swapper/200:06:442
1057999140,12cyclictest0-21swapper/222:10:192
1057999140,12cyclictest0-21swapper/219:25:012
1057899149,3cyclictest29681-21sh23:23:091
1057899149,3cyclictest0-21swapper/120:55:181
1057899144,8cyclictest31935-21munin-node1
1057899142,11cyclictest0-21swapper/100:20:121
10578991410,2cyclictest0-21swapper/122:45:181
1057899140,3cyclictest6512-21ssh00:05:141
1057899140,3cyclictest12636-21cut23:05:201
1057899140,2cyclictest0-21swapper/120:40:171
1057899140,12cyclictest26648-21diskmemload00:25:041
1057899140,12cyclictest0-21swapper/123:39:581
1057899140,12cyclictest0-21swapper/123:34:141
1057899140,12cyclictest0-21swapper/119:35:261
1057799140,2cyclictest0-21swapper/022:00:000
1057799140,12cyclictest0-21swapper/021:15:150
145632130,1sleep00-21swapper/022:02:030
1058099138,3cyclictest15185-21df_abs20:40:133
1058099132,6cyclictest0-21swapper/300:35:003
10580991310,2cyclictest0-21swapper/323:52:003
10580991310,2cyclictest0-21swapper/323:21:393
10580991310,2cyclictest0-21swapper/323:00:483
10580991310,2cyclictest0-21swapper/322:37:123
10580991310,2cyclictest0-21swapper/321:57:093
10580991310,2cyclictest0-21swapper/300:35:383
10580991310,2cyclictest0-21swapper/300:15:213
10580991310,2cyclictest0-21swapper/300:14:013
1058099130,2cyclictest0-21swapper/320:20:093
1058099130,2cyclictest0-21swapper/300:07:013
1058099130,12cyclictest0-21swapper/322:55:313
1058099130,12cyclictest0-21swapper/322:28:383
1058099130,11cyclictest26648-21diskmemload23:25:273
1058099130,11cyclictest19478-21ssh21:35:093
1057999138,3cyclictest29231-21ssh22:16:512
1057999131,10cyclictest0-21swapper/222:27:452
10579991310,2cyclictest9758-21kworker/u8:223:03:042
10579991310,2cyclictest28956-21kworker/u8:021:55:052
10579991310,2cyclictest16193-21kworker/u8:000:36:052
10579991310,2cyclictest0-21swapper/223:42:342
10579991310,2cyclictest0-21swapper/222:56:042
10579991310,2cyclictest0-21swapper/222:50:032
10579991310,2cyclictest0-21swapper/221:42:542
10579991310,2cyclictest0-21swapper/220:30:252
1057999130,2cyclictest0-21swapper/223:13:042
1057999130,2cyclictest0-21swapper/222:35:142
1057999130,2cyclictest0-21swapper/200:33:122
1057999130,2cyclictest0-21swapper/200:20:172
1057999130,12cyclictest0-21swapper/223:49:512
1057999130,12cyclictest0-21swapper/221:50:292
1057999130,12cyclictest0-21swapper/221:39:482
1057999130,12cyclictest0-21swapper/221:24:042
1057999130,11cyclictest0-21swapper/221:04:062
1057899138,3cyclictest0-21swapper/121:50:151
1057899138,3cyclictest0-21swapper/119:45:071
10578991310,2cyclictest0-21swapper/123:55:241
10578991310,2cyclictest0-21swapper/122:50:421
10578991310,2cyclictest0-21swapper/122:19:361
10578991310,2cyclictest0-21swapper/121:45:141
10578991310,2cyclictest0-21swapper/121:44:021
10578991310,2cyclictest0-21swapper/121:30:151
10578991310,2cyclictest0-21swapper/121:25:571
10578991310,2cyclictest0-21swapper/100:15:201
10578991310,2cyclictest0-21swapper/100:11:561
10578991310,2cyclictest0-21swapper/100:00:021
1057899130,2cyclictest6144-21sh22:25:491
1057899130,2cyclictest0-21swapper/123:51:181
1057899130,2cyclictest0-21swapper/123:00:581
1057899130,2cyclictest0-21swapper/122:30:131
1057899130,12cyclictest0-21swapper/123:47:561
1057899130,12cyclictest0-21swapper/122:14:481
1057899130,11cyclictest26648-21diskmemload21:38:521
1057899130,11cyclictest0-21swapper/123:40:091
1057899130,11cyclictest0-21swapper/100:30:191
10577991310,2cyclictest0-21swapper/022:25:120
10577991310,2cyclictest0-21swapper/021:13:110
1057799130,11cyclictest22594-21kworker/u8:021:01:040
60462120,2sleep00-21swapper/023:31:200
53092120,2sleep10-21swapper/100:36:021
313202120,1sleep00-21swapper/000:30:160
256772120,2sleep00-21swapper/022:45:320
1058099129,2cyclictest0-21swapper/320:05:203
1058099122,6cyclictest0-21swapper/319:25:013
1058099121,6cyclictest0-21swapper/320:30:003
1058099120,2cyclictest0-21swapper/322:08:593
1058099120,2cyclictest0-21swapper/320:10:213
1058099120,11cyclictest0-21swapper/323:31:083
1058099120,11cyclictest0-21swapper/323:07:483
1058099120,11cyclictest0-21swapper/300:27:223
1058099120,10cyclictest0-21swapper/321:50:443
1057999129,2cyclictest2523-21kworker/u8:023:55:032
1057999129,2cyclictest0-21swapper/221:45:142
1057999129,2cyclictest0-21swapper/221:26:232
1057999129,2cyclictest0-21swapper/221:10:042
1057999129,2cyclictest0-21swapper/220:10:262
1057999120,11cyclictest14607-21copy20:40:042
1057999120,11cyclictest0-21swapper/220:55:172
1057999120,11cyclictest0-21swapper/219:45:272
1057999120,11cyclictest0-21swapper/200:17:432
1057899129,2cyclictest26648-21diskmemload21:22:181
1057899129,2cyclictest0-21swapper/122:05:001
1057899129,2cyclictest0-21swapper/119:20:091
1057899128,2cyclictest0-21swapper/119:50:181
1057899127,3cyclictest0-21swapper/120:30:181
1057899121,3cyclictest14149-21unixbench_multi19:15:261
1057899120,2cyclictest0-21swapper/122:35:051
1057899120,11cyclictest0-21swapper/121:55:581
1057899120,11cyclictest0-21swapper/120:00:221
1057899120,11cyclictest0-21swapper/119:25:071
1057799128,3cyclictest9959-21awk22:30:150
1057799120,2cyclictest26648-21diskmemload22:10:160
1057799120,2cyclictest19140-21ssh21:34:570
1057799120,2cyclictest0-21swapper/022:42:170
1057799120,2cyclictest0-21swapper/021:20:150
1057799120,2cyclictest0-21swapper/020:40:110
1057799120,11cyclictest2677-21kworker/u8:120:13:040
1057799120,11cyclictest0-21swapper/022:50:260
1057799120,11cyclictest0-21swapper/022:22:370
1057799120,10cyclictest0-21swapper/023:02:580
1058099118,2cyclictest0-21swapper/320:45:143
1058099118,2cyclictest0-21swapper/319:35:193
1058099116,3cyclictest12958-21telnet19:15:133
1058099111,6cyclictest0-21swapper/319:40:223
1057999118,2cyclictest4859-21kworker/u8:219:32:032
1057999118,2cyclictest4859-21kworker/u8:219:15:032
1057999118,2cyclictest25042-21kworker/u8:019:53:042
1057999118,2cyclictest0-21swapper/220:50:162
1057999117,2cyclictest11466-21iostat_ios19:10:162
1057899117,2cyclictest0-21swapper/121:00:131
1057899111,3cyclictest12747-21munin-node1
1057899110,9cyclictest10790-21munin-node1
1057899110,9cyclictest0-21swapper/121:05:181
1057899110,9cyclictest0-21swapper/120:25:131
1057899110,9cyclictest0-21swapper/120:15:181
1057899110,9cyclictest0-21swapper/120:10:171
1057799118,2cyclictest29502-21kworker/u8:100:02:050
1057799118,2cyclictest0-21swapper/022:55:120
1057799118,2cyclictest0-21swapper/020:15:130
1057799113,5cyclictest0-21swapper/020:22:050
1057799113,4cyclictest0-21swapper/019:40:030
1057799110,9cyclictest8353-21kworker/u8:120:32:040
1057799110,2cyclictest0-21swapper/022:38:280
36562100,2sleep00-21swapper/021:50:390
274692100,7sleep00-21swapper/000:25:360
1058099105,3cyclictest18815-21munin-node3
1058099102,6cyclictest0-21swapper/320:30:013
1058099100,9cyclictest0-21swapper/320:00:193
1057999107,2cyclictest0-21swapper/220:35:002
1057999102,6cyclictest0-21swapper/220:20:592
1057899106,2cyclictest0-21swapper/119:40:101
1057899105,3cyclictest6868-21tail20:20:111
1057899101,2cyclictest0-21swapper/119:30:181
1057899100,8cyclictest0-21swapper/120:45:141
1057899100,8cyclictest0-21swapper/120:05:181
1057899100,2cyclictest0-21swapper/119:55:131
1057899100,2cyclictest0-21swapper/119:55:121
1057799107,2cyclictest26648-21diskmemload21:45:580
1057799107,2cyclictest26648-21diskmemload00:10:110
1057799107,2cyclictest0-21swapper/023:40:250
1057799107,2cyclictest0-21swapper/021:41:310
1057799107,2cyclictest0-21swapper/000:37:510
1057799107,2cyclictest0-21swapper/000:09:320
1057799100,9cyclictest30983-21kworker/u8:220:57:040
1057799100,9cyclictest20891-21ssh22:09:100
1057799100,9cyclictest12879-21kworker/u8:020:37:040
1057799100,9cyclictest0-21swapper/023:05:200
1057799100,9cyclictest0-21swapper/021:27:300
1057799100,9cyclictest0-21swapper/019:55:180
1057799100,9cyclictest0-21swapper/019:55:170
1057799100,9cyclictest0-21swapper/000:15:290
1057799100,2cyclictest26648-21diskmemload00:22:030
1057799100,2cyclictest0-21swapper/022:16:290
105809996,2cyclictest0-21swapper/319:50:103
105809995,2cyclictest0-21swapper/319:10:143
105809994,3cyclictest5466-21wc20:15:173
105809994,3cyclictest3745-21runrttasks19:55:023
105809994,3cyclictest3745-21runrttasks19:55:013
105809994,3cyclictest25360-21fschecks_count19:45:163
105809994,3cyclictest17447-21if_err_eth019:25:163
105809991,3cyclictest0-21swapper/321:05:163
105799996,2cyclictest4859-21kworker/u8:219:36:052
105799996,2cyclictest20351-21kworker/u8:120:00:042
105799994,3cyclictest8900-21cpu20:25:142
105799994,3cyclictest4921-21tr20:15:122
105799994,3cyclictest26236-21grep21:05:262
105799994,3cyclictest24658-21latency_hist19:45:002
105799994,3cyclictest183782sleep219:26:592
105799994,3cyclictest17709-21grep20:45:212
105789990,8cyclictest0-21swapper/120:50:101
105779996,2cyclictest26648-21diskmemload23:35:580
105779996,2cyclictest26648-21diskmemload23:10:380
105779996,2cyclictest0-21swapper/019:35:150
105779990,7cyclictest10790-21munin-node19:10:110
105779990,2cyclictest0-21swapper/020:25:130
105809983,3cyclictest18962-21aten2.4_r3power19:30:143
105799985,2cyclictest20351-21kworker/u8:119:55:052
105799985,2cyclictest20351-21kworker/u8:119:55:042
105799983,3cyclictest633-21aten2.4_r3power20:05:142
105779985,2cyclictest30966-21basename20:00:110
105779985,2cyclictest26648-21diskmemload23:45:040
105779985,2cyclictest0-21swapper/020:50:100
105779983,3cyclictest25933-21mailstats21:05:230
105779980,6cyclictest0-21swapper/019:45:070
105779980,2cyclictest0-21swapper/019:25:280
105779974,2cyclictest477-21sshd20:05:060
105779974,2cyclictest101ktimersoftd/019:30:110
105779974,2cyclictest0-21swapper/019:20:090
105779972,3cyclictest13849-21sendmail_mailst19:15:230
105779970,6cyclictest0-21swapper/020:46:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional