You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 04:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Sun Jan 11, 2026 00:45:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3850889991122,3cyclictest0-21swapper/021:35:010
3850894998623,25cyclictest3887644-21ssh22:15:171
3850894998623,25cyclictest3887644-21ssh22:15:171
3850894998527,18cyclictest3906053-21ssh22:55:021
3850894998328,16cyclictest3862454-21ssh21:21:061
3850894998328,16cyclictest3862454-21ssh21:21:051
3850894998234,14cyclictest3929195-21cut23:45:021
3850894998228,18cyclictest3935696-21ssh23:59:201
3850894998226,18cyclictest3870493-21ssh21:38:431
3850894998225,18cyclictest3858334-21ssh21:12:301
3850894998225,18cyclictest3858334-21ssh21:12:291
3850894998223,22cyclictest3865531-21ssh21:27:521
3850894998140,35cyclictest3854175-21cron20:15:011
3850894998135,18cyclictest3896302-21ssh22:34:151
3850894998135,18cyclictest3896302-21ssh22:34:141
385090599805,56cyclictest3866504-21sh21:30:013
3850894998027,15cyclictest3911301-21ssh23:06:271
3850894998027,15cyclictest3911301-21ssh23:06:261
3850894998027,15cyclictest3855518-21systemd-run20:40:001
3850894998025,21cyclictest3931395-21date23:50:011
3850894997935,16cyclictest3851090-21munin-run19:15:001
3850894997935,16cyclictest3851090-21munin-run19:15:001
3850894997927,20cyclictest3890546-21ssh22:21:351
3850894997926,16cyclictest3885689-21ssh22:11:101
3850894997924,22cyclictest3953019-21ssh00:36:331
3850894997826,16cyclictest3914017-21ssh23:12:261
3850894997824,16cyclictest3855765-21systemd-run20:45:011
3850894997731,13cyclictest3873094-21sh21:44:191
3850900997612,7cyclictest131rcu_preempt00:00:002
3850894997626,14cyclictest3945669-21ssh00:20:431
3850894997525,16cyclictest3909662-21ssh23:03:061
3850894997429,17cyclictest3916415-21sh23:17:381
3850894997419,16cyclictest3875485-21sshd21:49:301
3850894997419,16cyclictest3875485-21sshd21:49:301
3850894997325,15cyclictest3922531-21ssh23:30:291
3850894997325,15cyclictest3900997-21ssh22:44:241
3850894997224,16cyclictest3902097-21ssh22:46:301
3850889997158,9cyclictest0-21swapper/000:10:020
3850894997053,14cyclictest3897351-21ssh22:36:151
3850894997021,13cyclictest3922038-21ssh23:29:531
3850894997020,16cyclictest3857040-21diskmemload00:06:251
3850894997020,14cyclictest3925419-21ssh23:36:511
3850889997028,35cyclictest0-21swapper/000:40:010
3850894996951,14cyclictest3941079-21ssh00:10:401
3850894996925,15cyclictest3881123-21sh22:01:261
3850894996921,15cyclictest3948868-21ssh00:27:481
3850889996926,16cyclictest131rcu_preempt19:50:010
3850894996853,12cyclictest3884026-21ssh22:07:391
3850894996828,13cyclictest364-21snmpd19:41:371
3850894996828,13cyclictest364-21snmpd19:41:361
3850894996719,13cyclictest3933268-21ssh23:54:081
385090599661,51cyclictest3954581-21ssh00:40:023
3850894996651,12cyclictest3944557-21ssh00:18:321
3850894996546,15cyclictest3950424-21ssh00:30:521
3850894996545,16cyclictest3876525-21ssh21:51:271
3850894996520,15cyclictest3853058-21latency_hist19:50:011
3850894996445,15cyclictest3918935-21ssh23:23:011
3850894996445,15cyclictest3859716-21ssh21:15:111
3850894996445,14cyclictest3892855-21ssh22:26:251
3850894996444,16cyclictest3936309-21ssh00:00:191
3850894996444,16cyclictest3936309-21ssh00:00:191
3850889996426,33cyclictest3861743-21cron21:20:000
3850894996350,10cyclictest3905192-21ssh22:53:221
3850894996346,14cyclictest3878560-21ssh21:55:491
3850894996343,16cyclictest3866678-21ssh21:30:081
3850894996318,15cyclictest0-21swapper/119:30:031
3850894996318,15cyclictest0-21swapper/119:30:021
3850889996231,18cyclictest131rcu_preempt21:13:040
3850889996231,18cyclictest131rcu_preempt21:13:030
3850894996142,15cyclictest3856022-21munin-run20:50:011
3850894996114,13cyclictest3853917-21sshd20:08:301
3850889996023,33cyclictest12-21ksoftirqd/022:39:590
385088999601,39cyclictest39212041ssh23:27:560
3850894995950,5cyclictest3853393-21sshd19:59:291
3850894995950,5cyclictest3853393-21sshd19:59:291
3850889995918,34cyclictest16850irq/134-800000023:04:590
3850894995846,9cyclictest3857015-21sshd21:08:011
3850894995844,11cyclictest3851610-21sshd19:24:291
3850889995847,3cyclictest0-21swapper/023:50:030
3850889995831,11cyclictest3895142-21ssh22:31:270
3850889995831,11cyclictest3895142-21ssh22:31:260
3850889995825,16cyclictest3939235-21ssh00:06:520
3850889995811,42cyclictest275-21dbus-daemon00:20:000
385090599579,34cyclictest361rcuc/322:10:023
3850894995744,10cyclictest3856258-21munin-run20:55:011
3850894995744,10cyclictest3855242-21munin-run20:35:011
3850894995744,10cyclictest3855242-21munin-run20:35:011
3850889995725,28cyclictest12-21ksoftirqd/000:00:000
3850889995719,6cyclictest131rcu_preempt21:40:000
385088999571,27cyclictest131rcu_preempt22:05:020
3850894995643,10cyclictest3856481-21sshd20:57:301
3850889995619,32cyclictest16850irq/134-800000021:26:330
3850889995618,33cyclictest16850irq/134-800000000:01:470
3850889995618,33cyclictest16850irq/134-800000000:01:460
3850889995617,31cyclictest12-21ksoftirqd/000:28:220
3850894995537,14cyclictest364-21snmpd21:03:141
3850894995535,15cyclictest364-21snmpd19:31:441
385088999552,10cyclictest3851627-21munin-run19:25:000
3850889995520,31cyclictest16850irq/134-800000021:56:390
3850889995518,32cyclictest16850irq/134-800000022:50:200
3850889995518,32cyclictest16850irq/134-800000022:18:050
3850889995518,32cyclictest16850irq/134-800000022:18:040
3850889995517,33cyclictest16850irq/134-800000023:31:220
3850889995517,33cyclictest16850irq/134-800000022:55:230
3850889995517,33cyclictest16850irq/134-800000022:40:100
3850889995437,13cyclictest1-21systemd22:25:010
3850889995419,31cyclictest16850irq/134-800000021:20:430
3850889995419,31cyclictest16850irq/134-800000021:20:420
3850889995418,6cyclictest16850irq/134-800000023:14:370
3850889995418,32cyclictest16850irq/134-800000023:41:550
3850889995418,32cyclictest16850irq/134-800000021:53:380
3850889995417,32cyclictest16850irq/134-800000023:07:280
3850889995417,32cyclictest16850irq/134-800000023:07:270
3850889995416,33cyclictest16850irq/134-800000000:33:020
3850889995411,8cyclictest131rcu_preempt19:20:000
385090599532,6cyclictest131rcu_preempt23:20:003
3850894995342,7cyclictest3853171-21munin-run19:55:021
3850894995335,14cyclictest364-21snmpd20:22:261
3850894995334,14cyclictest364-21snmpd20:27:191
385088999533,44cyclictest3855519-21unin-run20:40:000
3850889995319,6cyclictest16850irq/134-800000021:40:270
3850889995319,30cyclictest16850irq/134-800000022:25:560
3850889995318,31cyclictest16850irq/134-800000023:35:420
3850889995317,6cyclictest16850irq/134-800000022:12:030
3850889995317,32cyclictest16850irq/134-800000021:47:170
3850889995317,32cyclictest16850irq/134-800000021:47:160
3850889995317,32cyclictest16850irq/134-800000000:20:530
3850889995316,32cyclictest16850irq/134-800000023:16:460
3850900995213,6cyclictest131rcu_preempt23:45:552
3850894995240,9cyclictest364-21snmpd19:16:031
3850894995239,10cyclictest364-21snmpd20:00:051
3850889995218,30cyclictest16850irq/134-800000022:06:470
3850889995216,31cyclictest16850irq/134-800000022:45:100
385090099516,6cyclictest131rcu_preempt23:53:412
3850900995137,9cyclictest30-21ksoftirqd/219:45:012
3850900995137,9cyclictest30-21ksoftirqd/219:45:002
3850894995138,9cyclictest364-21snmpd20:15:131
3850889995117,31cyclictest16850irq/134-800000023:52:480
3850905995036,9cyclictest3868740-21cron21:35:013
3850905995035,11cyclictest1-21systemd23:50:023
385090099506,6cyclictest131rcu_preempt19:20:002
385090099504,10cyclictest30-21ksoftirqd/221:00:322
3850889995014,31cyclictest16850irq/134-800000023:21:250
3850905994912,5cyclictest131rcu_preempt21:25:023
3850905994912,5cyclictest131rcu_preempt21:25:013
385090099496,6cyclictest131rcu_preempt00:29:592
3850889994921,4cyclictest131rcu_preempt20:35:010
3850889994921,4cyclictest131rcu_preempt20:35:010
385090599484,11cyclictest37-21ksoftirqd/322:39:593
385090099482,7cyclictest131rcu_preempt21:00:002
3850894994837,8cyclictest364-21snmpd19:36:481
3850889994812,6cyclictest131rcu_preempt20:50:030
3850905994732,11cyclictest1-21systemd20:45:003
3850900994734,9cyclictest3954462-21cron00:40:012
3850900994712,6cyclictest131rcu_preempt22:00:022
3850889994733,10cyclictest3467602-21systemd-journal19:10:020
3850889994733,10cyclictest3467602-21systemd-journal19:10:020
3850905994633,9cyclictest1-21systemd21:10:003
3850905994624,17cyclictest3467602-21systemd-journal20:10:003
3850905994614,21cyclictest37-21ksoftirqd/323:21:023
3850900994630,7cyclictest30-21ksoftirqd/222:25:012
385090099462,5cyclictest131rcu_preempt00:15:022
3850900994615,10cyclictest30-21ksoftirqd/222:35:022
3850900994615,10cyclictest30-21ksoftirqd/222:35:012
3850900994611,6cyclictest131rcu_preempt20:35:012
3850900994611,6cyclictest131rcu_preempt20:35:002
3850889994637,5cyclictest3850902-21ls19:10:010
3850889994622,20cyclictest3852834-21latency_hist19:45:020
3850889994622,20cyclictest3852834-21latency_hist19:45:020
385090099459,6cyclictest131rcu_preempt22:15:012
385090099459,6cyclictest131rcu_preempt20:15:002
385090099459,5cyclictest131rcu_preempt22:40:002
385090099458,6cyclictest131rcu_preempt00:35:002
385090099455,34cyclictest3905938-21sort22:55:012
3850900994533,10cyclictest30-21ksoftirqd/221:20:012
3850900994530,11cyclictest3878093-21date21:55:012
3850900994517,6cyclictest30-21ksoftirqd/223:40:032
385090099451,23cyclictest0-21swapper/222:20:032
385090099451,23cyclictest0-21swapper/222:20:022
3850900994511,5cyclictest131rcu_preempt00:24:512
3850889994514,6cyclictest131rcu_preempt21:05:000
385090599446,6cyclictest131rcu_preempt22:20:013
385090599446,6cyclictest131rcu_preempt22:20:003
3850905994429,12cyclictest3852613-21sed19:40:033
3850905994425,13cyclictest1-21systemd00:20:003
385090099448,5cyclictest131rcu_preempt23:19:482
3850900994420,17cyclictest0-21swapper/221:29:262
385090099441,5cyclictest131rcu_preempt00:15:102
3850900994414,6cyclictest131rcu_preempt23:01:552
385088999448,7cyclictest12-21ksoftirqd/020:15:000
3850889994437,4cyclictest16950irq/224-800000020:25:000
3850889994437,4cyclictest16950irq/224-800000020:05:000
385088999442,6cyclictest3854459-21munin-run20:20:000
385090599435,6cyclictest131rcu_preempt00:00:003
3850905994328,12cyclictest37-21ksoftirqd/322:55:243
3850905994321,7cyclictest37-21ksoftirqd/322:00:313
3850905994317,22cyclictest131rcu_preempt22:22:323
3850905994310,5cyclictest131rcu_preempt22:40:053
385090099438,5cyclictest131rcu_preempt22:04:322
385090099435,6cyclictest131rcu_preempt19:30:012
385090099435,6cyclictest131rcu_preempt19:30:012
385090099434,5cyclictest131rcu_preempt22:46:232
3850900994335,5cyclictest3857040-21diskmemload23:00:032
3850894994327,13cyclictest3850885-21cyclictest19:10:011
385088999432,37cyclictest3853439-21modprobe20:00:010
385088999432,37cyclictest3853439-21modprobe20:00:000
3850905994229,8cyclictest3911978-21sshd23:08:123
3850905994229,8cyclictest3911978-21sshd23:08:123
3850905994226,12cyclictest3467602-21systemd-journal20:05:023
385090599421,6cyclictest131rcu_preempt19:50:003
385090599421,5cyclictest131rcu_preempt23:11:203
385090599421,5cyclictest131rcu_preempt21:40:003
3850905994215,18cyclictest37-21ksoftirqd/300:05:053
3850905994214,19cyclictest37-21ksoftirqd/323:43:243
3850905994213,20cyclictest37-21ksoftirqd/321:49:413
3850905994213,20cyclictest37-21ksoftirqd/321:49:403
3850905994212,20cyclictest37-21ksoftirqd/323:53:123
385090099425,6cyclictest131rcu_preempt22:42:592
385090099421,7cyclictest131rcu_preempt21:25:002
385090099421,7cyclictest131rcu_preempt21:25:002
3850900994217,5cyclictest30-21ksoftirqd/221:30:362
385088999424,7cyclictest275-21dbus-daemon19:35:000
3850905994130,8cyclictest37-21ksoftirqd/300:15:003
3850905994128,10cyclictest275-21dbus-daemon23:30:013
3850905994126,12cyclictest3467602-21systemd-journal23:40:003
3850905994125,13cyclictest37-21ksoftirqd/319:45:013
3850905994125,13cyclictest37-21ksoftirqd/319:45:013
385090599411,6cyclictest131rcu_preempt21:00:013
385090599411,5cyclictest131rcu_preempt22:50:003
385090599411,5cyclictest131rcu_preempt21:55:023
385090599411,5cyclictest131rcu_preempt20:30:013
3850905994115,9cyclictest0-21swapper/322:28:133
385090599411,4cyclictest131rcu_preempt22:35:023
385090599411,4cyclictest131rcu_preempt22:35:013
3850905994114,20cyclictest37-21ksoftirqd/300:33:283
385090099418,4cyclictest131rcu_preempt22:27:322
385090099417,5cyclictest131rcu_preempt00:03:572
385090099417,5cyclictest131rcu_preempt00:03:562
3850900994130,7cyclictest3852347-21sshd19:36:292
3850900994129,8cyclictest3467602-21systemd-journal20:02:472
3850900994123,14cyclictest275-21dbus-daemon20:40:002
385090099411,8cyclictest0-21swapper/221:08:002
3850900994118,5cyclictest30-21ksoftirqd/222:05:102
3850900994118,4cyclictest30-21ksoftirqd/223:11:232
3850900994115,21cyclictest131rcu_preempt21:40:032
3850900994112,10cyclictest30-21ksoftirqd/221:38:562
3850900994110,6cyclictest131rcu_preempt23:25:002
385088999413,34cyclictest3855896-21latency_hist20:45:020
3850889994115,20cyclictest131rcu_preempt20:30:010
385090599404,4cyclictest131rcu_preempt21:17:423
3850905994027,10cyclictest1-21systemd00:25:013
3850905994025,11cyclictest37-21ksoftirqd/323:01:333
3850905994011,20cyclictest37-21ksoftirqd/322:13:413
385090099406,6cyclictest131rcu_preempt23:44:042
3850900994023,12cyclictest3467602-21systemd-journal19:55:002
3850900994018,4cyclictest30-21ksoftirqd/223:09:562
3850900994018,4cyclictest30-21ksoftirqd/223:09:552
3850900994018,4cyclictest30-21ksoftirqd/221:46:412
3850900994018,4cyclictest30-21ksoftirqd/221:46:402
385090099401,6cyclictest0-21swapper/200:05:112
385088999408,5cyclictest131rcu_preempt20:55:000
3850889994032,6cyclictest12-21ksoftirqd/021:10:010
385090599399,8cyclictest37-21ksoftirqd/321:57:173
385090599393,5cyclictest131rcu_preempt21:05:013
3850905993927,9cyclictest37-21ksoftirqd/320:35:033
3850905993926,10cyclictest3859415-21cron21:15:003
3850905993926,10cyclictest3859415-21cron21:15:003
3850905993925,12cyclictest37-21ksoftirqd/300:29:333
3850905993919,4cyclictest37-21ksoftirqd/319:20:003
385090599391,6cyclictest131rcu_preempt19:25:013
3850900993928,5cyclictest309-21in:imuxsock20:20:022
3850900993924,11cyclictest3855769-21pluginstate20:45:012
3850900993919,5cyclictest30-21ksoftirqd/223:28:102
3850900993919,4cyclictest30-21ksoftirqd/219:32:412
3850900993917,6cyclictest3853934-21latency_hist20:10:032
3850900993917,4cyclictest30-21ksoftirqd/221:10:172
3850900993917,4cyclictest30-21ksoftirqd/221:10:162
3850900993914,20cyclictest131rcu_preempt23:30:272
385088999395,30cyclictest3853925-21cron20:10:000
3850889993931,4cyclictest16950irq/224-800000019:40:010
385090599383,5cyclictest131rcu_preempt21:40:313
3850905993823,12cyclictest3853589-21cat20:00:033
3850905993823,12cyclictest3853589-21cat20:00:023
3850905993823,11cyclictest3467602-21systemd-journal19:30:283
385090599373,5cyclictest131rcu_preempt23:32:453
3850905993725,8cyclictest3854407-21sshd20:16:303
3850905993723,11cyclictest37-21ksoftirqd/319:55:003
3850905993722,10cyclictest275-21dbus-daemon19:15:023
3850905993722,10cyclictest275-21dbus-daemon19:15:013
3850905993714,5cyclictest131rcu_preempt00:00:253
3850905993714,5cyclictest131rcu_preempt00:00:243
385090099379,6cyclictest131rcu_preempt20:20:302
3850900993725,9cyclictest3851224-21wc19:15:032
3850900993725,9cyclictest3851224-21wc19:15:022
385090099372,4cyclictest3854968-21modprobe20:30:002
3850900993722,11cyclictest3850983-21cat19:10:022
385088999377,6cyclictest131rcu_preempt20:57:310
385090599365,5cyclictest131rcu_preempt20:35:013
3850905993625,8cyclictest3856227-21sshd20:51:313
3850905993624,8cyclictest0-21swapper/320:15:013
3850905993623,10cyclictest37-21ksoftirqd/322:50:243
385090099361,3cyclictest131rcu_preempt20:50:022
385090099356,5cyclictest131rcu_preempt20:53:312
385090099352,3cyclictest131rcu_preempt19:24:422
385090099351,5cyclictest131rcu_preempt19:50:002
3850889993523,9cyclictest309-21in:imuxsock19:51:280
385090599344,6cyclictest131rcu_preempt20:50:013
3850905993415,15cyclictest131rcu_preempt19:30:013
3850905993415,15cyclictest131rcu_preempt19:30:013
385088999346,5cyclictest131rcu_preempt19:30:030
385088999346,5cyclictest131rcu_preempt19:30:020
385090599333,2cyclictest0-21swapper/319:10:023
385090599332,5cyclictest131rcu_preempt20:40:013
3850905993316,13cyclictest3467602-21systemd-journal20:25:003
3850900993317,3cyclictest30-21ksoftirqd/219:55:042
3850900993317,3cyclictest30-21ksoftirqd/219:55:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional