注意
点击此处下载完整示例代码
简介 torch.compile¶
创建日期：2023 年 3 月 15 日 | 最后更新：2025 年 4 月 1 日 | 最后验证：2024 年 11 月 5 日
作者： William Wen
torch.compile 是加速 PyTorch 代码的最新方法！torch.compile 通过将 PyTorch 代码 JIT 编译为优化的内核，使 PyTorch 代码运行得更快，同时只需极少的代码更改。
在本教程中，我们将介绍 torch.compile 的基本用法，并展示 torch.compile 相较于之前的 PyTorch 编译器解决方案（例如 TorchScript 和 FX Tracing）的优势。
目录
所需的 pip 依赖项
torch >= 2.0torchvisionnumpyscipytabulate
系统要求 - C++ 编译器，例如 g++ - Python 开发包 (python-devel/python-dev)
注意：为了重现下方以及其他地方记录的加速数字，建议使用现代 NVIDIA GPU (H100、A100 或 V100) 来运行本教程。
import torch
import warnings
gpu_ok = False
if torch.cuda.is_available():
device_cap = torch.cuda.get_device_capability()
if device_cap in ((7, 0), (8, 0), (9, 0)):
gpu_ok = True
if not gpu_ok:
warnings.warn(
"GPU is not NVIDIA V100, A100, or H100. Speedup numbers may be lower "
"than expected."
)
/var/lib/workspace/intermediate_source/torch_compile_tutorial.py:52: UserWarning:
GPU is not NVIDIA V100, A100, or H100. Speedup numbers may be lower than expected.
基本用法¶
最新版本的 PyTorch 中包含了 torch.compile。在 GPU 上运行 TorchInductor 需要 Triton，它已包含在 PyTorch 2.0 nightly 二进制包中。如果 Triton 仍然缺失，请尝试通过 pip 安装 torchtriton（适用于 CUDA 11.7 的命令为 pip install torchtriton --extra-index-url "https://download.pytorch.org/whl/nightly/cu117"）。
可以将可调用对象传递给 torch.compile 来优化任意 Python 函数。然后，我们可以调用返回的优化函数来替代原函数。
def foo(x, y):
a = torch.sin(x)
b = torch.cos(y)
return a + b
opt_foo1 = torch.compile(foo)
print(opt_foo1(torch.randn(10, 10), torch.randn(10, 10)))
tensor([[ 1.6850, 1.9924, 1.7090, 0.0034, 1.1414, -0.1822, 0.4861, -0.0536,
-0.2252, 1.9398],
[ 0.3693, -0.0695, 0.1748, 0.3436, 0.1939, 1.5721, 1.9882, -0.2235,
0.3161, 1.2642],
[ 0.2480, 1.8793, 1.7152, 1.6772, 1.8881, 1.4748, 1.3466, 1.7763,
0.7469, 1.0407],
[-0.1121, 1.6015, -0.0188, 0.2128, 0.5218, 1.9838, 0.8185, 0.5093,
-0.3603, 0.1793],
[-1.7890, 1.7532, -0.4040, 0.1222, -0.0029, 1.7975, -0.3877, 0.5123,
0.1673, 0.1330],
[ 1.0627, 0.9609, 0.1019, 1.8814, 0.1142, -0.2338, -0.9621, 0.7631,
0.6506, 0.1853],
[ 0.4584, 1.7648, -0.0444, 1.9610, 1.5884, 0.7353, 1.2190, 1.3662,
1.0938, -0.1587],
[-0.7502, 1.6640, 0.3495, 1.3496, 0.8187, 1.1719, 0.5820, 0.1498,
0.0885, 0.1036],
[ 0.3961, 0.6043, -0.0861, -0.3371, 0.8622, 1.4341, 1.2988, 0.5023,
0.3074, 0.1277],
[ 0.9748, 0.4117, 1.2616, 1.6314, 0.4693, 0.4092, 0.0401, 1.1196,
1.2458, 1.3280]])
或者，我们可以使用装饰器修饰函数。
t1 = torch.randn(10, 10)
t2 = torch.randn(10, 10)
@torch.compile
def opt_foo2(x, y):
a = torch.sin(x)
b = torch.cos(y)
return a + b
print(opt_foo2(t1, t2))
tensor([[ 0.5360, 0.1697, -0.0561, 0.1890, -0.1310, 1.2276, 1.1739, 0.1944,
-0.1561, 1.6990],
[ 1.0421, 1.9472, 0.2682, 0.2701, 1.3346, 0.7651, 1.0897, 1.1730,
0.6161, 0.9223],
[ 1.5756, 1.5294, 0.0112, -0.1522, -0.7674, 1.8515, -0.2443, 0.3696,
0.2693, 0.8735],
[-0.3701, 1.1190, 1.4164, 1.8648, 1.2080, 0.0732, 1.5274, 0.6868,
1.2440, 1.0715],
[-1.2454, -0.0159, 0.4315, 0.1317, 1.0530, -1.0603, -0.0532, 0.6661,
1.7101, -0.2076],
[-0.7091, 0.7824, 1.7161, 1.2750, 0.6368, 1.2488, 0.4897, 1.2429,
1.3409, 1.3735],
[ 0.8345, 0.0653, 0.3462, 1.2383, -0.4092, 1.6438, -0.0962, 0.4011,
0.2463, -0.5802],
[ 1.6349, 0.7297, 1.2547, -0.3113, 0.9310, 0.1162, 1.7618, 0.4882,
0.7640, 0.2930],
[ 1.1669, -0.7775, 1.2000, 0.6008, -0.2814, 0.5541, 0.5753, 1.4731,
1.6835, 0.7370],
[ 1.5087, 0.6195, 0.1153, 1.2966, 1.8815, 1.1678, 1.5686, 1.6018,
0.2193, 1.3500]])
我们还可以优化 torch.nn.Module 的实例。
t = torch.randn(10, 100)
class MyModule(torch.nn.Module):
def __init__(self):
super().__init__()
self.lin = torch.nn.Linear(100, 10)
def forward(self, x):
return torch.nn.functional.relu(self.lin(x))
mod = MyModule()
opt_mod = torch.compile(mod)
print(opt_mod(t))
tensor([[0.0000, 0.7610, 0.2562, 0.0405, 0.0000, 0.3631, 0.3325, 0.0000, 0.4574,
0.8850],
[0.4322, 0.0984, 0.3238, 0.0000, 0.0000, 0.0000, 0.0000, 0.0000, 1.0738,
0.1925],
[0.0413, 0.1075, 0.0000, 0.0000, 0.2039, 0.0000, 1.7316, 0.0000, 0.0000,
0.5836],
[0.2436, 0.0000, 0.9565, 0.0000, 0.9550, 0.6644, 0.0000, 0.0000, 0.7600,
0.0000],
[0.0000, 0.3446, 0.0000, 0.5052, 1.1132, 0.0233, 0.0000, 0.1331, 0.5702,
1.9597],
[0.5364, 0.9321, 0.4773, 0.0000, 0.0000, 0.5301, 0.0000, 0.2444, 0.2557,
0.0000],
[0.0000, 0.0000, 0.8326, 0.0000, 0.5457, 0.0885, 0.0000, 1.1365, 0.0000,
0.1474],
[0.7596, 0.0000, 0.0000, 0.6814, 0.0000, 0.0000, 0.0000, 0.2448, 0.4532,
0.0000],
[0.0000, 0.0000, 0.0000, 0.0000, 0.5201, 0.0000, 0.6107, 0.3494, 0.2592,
0.6562],
[0.5368, 0.8832, 0.6859, 0.0000, 0.0000, 0.4080, 0.0000, 0.0000, 0.0000,
0.0000]], grad_fn=<CompiledFunctionBackward>)
torch.compile 与嵌套调用¶
被装饰函数中的嵌套函数调用也将被编译。
tensor([[ 0.5360, 0.1697, -0.0561, 0.1890, -0.1310, 1.2276, 1.1739, 0.1944,
-0.1561, 1.6990],
[ 1.0421, 1.9472, 0.2682, 0.2701, 1.3346, 0.7651, 1.0897, 1.1730,
0.6161, 0.9223],
[ 1.5756, 1.5294, 0.0112, -0.1522, -0.7674, 1.8515, -0.2443, 0.3696,
0.2693, 0.8735],
[-0.3701, 1.1190, 1.4164, 1.8648, 1.2080, 0.0732, 1.5274, 0.6868,
1.2440, 1.0715],
[-1.2454, -0.0159, 0.4315, 0.1317, 1.0530, -1.0603, -0.0532, 0.6661,
1.7101, -0.2076],
[-0.7091, 0.7824, 1.7161, 1.2750, 0.6368, 1.2488, 0.4897, 1.2429,
1.3409, 1.3735],
[ 0.8345, 0.0653, 0.3462, 1.2383, -0.4092, 1.6438, -0.0962, 0.4011,
0.2463, -0.5802],
[ 1.6349, 0.7297, 1.2547, -0.3113, 0.9310, 0.1162, 1.7618, 0.4882,
0.7640, 0.2930],
[ 1.1669, -0.7775, 1.2000, 0.6008, -0.2814, 0.5541, 0.5753, 1.4731,
1.6835, 0.7370],
[ 1.5087, 0.6195, 0.1153, 1.2966, 1.8815, 1.1678, 1.5686, 1.6018,
0.2193, 1.3500]])
同样地，当编译一个模块时，其中不在跳过列表（skip list）中的所有子模块和方法也会被编译。
class OuterModule(torch.nn.Module):
def __init__(self):
super().__init__()
self.inner_module = MyModule()
self.outer_lin = torch.nn.Linear(10, 2)
def forward(self, x):
x = self.inner_module(x)
return torch.nn.functional.relu(self.outer_lin(x))
outer_mod = OuterModule()
opt_outer_mod = torch.compile(outer_mod)
print(opt_outer_mod(t))
tensor([[0.0000, 0.1057],
[0.0000, 0.2927],
[0.0000, 0.0000],
[0.3042, 0.0000],
[0.0000, 0.0000],
[0.1152, 0.2923],
[0.0000, 0.1439],
[0.0000, 0.4087],
[0.0000, 0.2846],
[0.2514, 0.4253]], grad_fn=<CompiledFunctionBackward>)
我们还可以使用 torch.compiler.disable 禁用某些函数被编译。假设你只想禁用 complex_function 函数的追踪，但想让 complex_conjugate 中的追踪继续进行。在这种情况下，你可以使用 torch.compiler.disable(recursive=False) 选项。否则，默认值为 recursive=True。
def complex_conjugate(z):
return torch.conj(z)
@torch.compiler.disable(recursive=False)
def complex_function(real, imag):
# Assuming this function cause problems in the compilation
z = torch.complex(real, imag)
return complex_conjugate(z)
def outer_function():
real = torch.tensor([2, 3], dtype=torch.float32)
imag = torch.tensor([4, 5], dtype=torch.float32)
z = complex_function(real, imag)
return torch.abs(z)
# Try to compile the outer_function
try:
opt_outer_function = torch.compile(outer_function)
print(opt_outer_function())
except Exception as e:
print("Compilation of outer_function failed:", e)
/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/_inductor/lowering.py:1917: UserWarning:
Torchinductor does not support code generation for complex operators. Performance may be worse than eager.
tensor([4.4721, 5.8310])
最佳实践与建议¶
torch.compile 处理嵌套模块和函数调用的行为
当你使用 torch.compile 时，编译器会尝试递归地编译目标函数或模块内部不在跳过列表（skip list）（例如内置函数、torch.* 命名空间中的一些函数）中的每一个函数调用。
最佳实践
1. 顶层编译：一种方法是在尽可能高的层级进行编译（即当顶层模块被初始化/调用时），并在遇到过多的图断点（graph breaks）或错误时选择性地禁用编译。如果仍然存在许多编译问题，则改为编译单个子组件。
2. 模块化测试：在将单个函数和模块集成到大型模型中之前，先使用 torch.compile 对它们进行测试，以隔离潜在问题。
3. 选择性禁用编译：如果某些函数或子模块无法由 torch.compile 处理，请使用 torch.compiler.disable 上下文管理器递归地将它们从编译中排除。
4. 优先编译叶子函数：在包含多个嵌套函数和模块的复杂模型中，首先编译叶子函数或模块。更多信息请参见TorchDynamo APIs for fine-grained tracing。
演示加速效果¶
现在，让我们演示使用 torch.compile 如何加速实际模型。我们将通过在随机数据上评估和训练一个 torchvision 模型来比较标准 eager 模式和 torch.compile。
开始之前，我们需要定义一些工具函数。
# Returns the result of running `fn()` and the time it took for `fn()` to run,
# in seconds. We use CUDA events and synchronization for the most accurate
# measurements.
def timed(fn):
start = torch.cuda.Event(enable_timing=True)
end = torch.cuda.Event(enable_timing=True)
start.record()
result = fn()
end.record()
torch.cuda.synchronize()
return result, start.elapsed_time(end) / 1000
# Generates random input and targets data for the model, where `b` is
# batch size.
def generate_data(b):
return (
torch.randn(b, 3, 128, 128).to(torch.float32).cuda(),
torch.randint(1000, (b,)).cuda(),
)
N_ITERS = 10
from torchvision.models import densenet121
def init_model():
return densenet121().to(torch.float32).cuda()
首先，我们来比较推理（inference）。
注意，在调用 torch.compile 时，我们使用了额外的 mode 参数，我们将在下面讨论它。
model = init_model()
# Reset since we are using a different mode.
import torch._dynamo
torch._dynamo.reset()
model_opt = torch.compile(model, mode="reduce-overhead")
inp = generate_data(16)[0]
with torch.no_grad():
print("eager:", timed(lambda: model(inp))[1])
print("compile:", timed(lambda: model_opt(inp))[1])
eager: 0.34501324462890626
/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/_inductor/compile_fx.py:236: UserWarning:
TensorFloat32 tensor cores for float32 matrix multiplication available but not enabled. Consider setting `torch.set_float32_matmul_precision('high')` for better performance.
compile: 67.4805234375
请注意，torch.compile 完成所需的时间比 eager 模式长得多。这是因为 torch.compile 在执行时将模型编译为优化的内核。在我们的示例中，模型的结构没有改变，因此不需要重新编译。所以如果我们将优化后的模型再运行几次，应该会看到相对于 eager 模式的显著改进。
eager_times = []
for i in range(N_ITERS):
inp = generate_data(16)[0]
with torch.no_grad():
_, eager_time = timed(lambda: model(inp))
eager_times.append(eager_time)
print(f"eager eval time {i}: {eager_time}")
print("~" * 10)
compile_times = []
for i in range(N_ITERS):
inp = generate_data(16)[0]
with torch.no_grad():
_, compile_time = timed(lambda: model_opt(inp))
compile_times.append(compile_time)
print(f"compile eval time {i}: {compile_time}")
print("~" * 10)
import numpy as np
eager_med = np.median(eager_times)
compile_med = np.median(compile_times)
speedup = eager_med / compile_med
assert(speedup > 1)
print(f"(eval) eager median: {eager_med}, compile median: {compile_med}, speedup: {speedup}x")
print("~" * 10)
eager eval time 0: 0.017486879348754883
eager eval time 1: 0.015920127868652344
eager eval time 2: 0.01597542381286621
eager eval time 3: 0.016075775146484374
eager eval time 4: 0.01580031967163086
eager eval time 5: 0.015770624160766602
eager eval time 6: 0.015754240036010742
eager eval time 7: 0.01593855953216553
eager eval time 8: 0.01576857566833496
eager eval time 9: 0.015785823822021483
~~~~~~~~~~
compile eval time 0: 0.6994595947265625
compile eval time 1: 0.00880742359161377
compile eval time 2: 0.009005056381225587
compile eval time 3: 0.008050687789916992
compile eval time 4: 0.0081080322265625
compile eval time 5: 0.008088576316833495
compile eval time 6: 0.008187904357910156
compile eval time 7: 0.008077312469482421
compile eval time 8: 0.008122367858886719
compile eval time 9: 0.008196096420288086
~~~~~~~~~~
(eval) eager median: 0.015860223770141603, compile median: 0.008155136108398436, speedup: 1.9448141097005365x
~~~~~~~~~~
确实，我们可以看到使用 torch.compile 运行模型会带来显著加速。加速主要来自于减少 Python 开销和 GPU 读写，因此观察到的加速效果可能会因模型架构和批量大小等因素而异。例如，如果模型的架构简单且数据量很大，那么瓶颈将是 GPU 计算，观察到的加速效果可能不太显著。
根据选择的 mode 参数，你可能会看到不同的加速结果。"reduce-overhead" 模式使用 CUDA graphs 进一步减少 Python 的开销。对于你自己的模型，你可能需要尝试不同的模式以最大化加速。你可以在此处阅读更多关于模式的信息。
你可能还会注意到，第二次使用 torch.compile 运行模型的时间比其他运行要慢得多，尽管它比第一次运行快很多。这是因为 "reduce-overhead" 模式会为 CUDA graphs 运行几次热身迭代。
对于一般的 PyTorch 基准测试，你可以尝试使用 torch.utils.benchmark，而不是我们在上面定义的 timed 函数。我们在本教程中编写了自己的计时函数，以展示 torch.compile 的编译延迟。
现在，我们来比较训练。
model = init_model()
opt = torch.optim.Adam(model.parameters())
def train(mod, data):
opt.zero_grad(True)
pred = mod(data[0])
loss = torch.nn.CrossEntropyLoss()(pred, data[1])
loss.backward()
opt.step()
eager_times = []
for i in range(N_ITERS):
inp = generate_data(16)
_, eager_time = timed(lambda: train(model, inp))
eager_times.append(eager_time)
print(f"eager train time {i}: {eager_time}")
print("~" * 10)
model = init_model()
opt = torch.optim.Adam(model.parameters())
train_opt = torch.compile(train, mode="reduce-overhead")
compile_times = []
for i in range(N_ITERS):
inp = generate_data(16)
_, compile_time = timed(lambda: train_opt(model, inp))
compile_times.append(compile_time)
print(f"compile train time {i}: {compile_time}")
print("~" * 10)
eager_med = np.median(eager_times)
compile_med = np.median(compile_times)
speedup = eager_med / compile_med
assert(speedup > 1)
print(f"(train) eager median: {eager_med}, compile median: {compile_med}, speedup: {speedup}x")
print("~" * 10)
eager train time 0: 0.28113409423828123
eager train time 1: 0.048817150115966795
eager train time 2: 0.047652862548828126
eager train time 3: 0.04659097671508789
eager train time 4: 0.04691542434692383
eager train time 5: 0.04693401718139648
eager train time 6: 0.04683468627929688
eager train time 7: 0.046445568084716796
eager train time 8: 0.04698112106323242
eager train time 9: 0.046666751861572264
~~~~~~~~~~
compile train time 0: 167.237015625
compile train time 1: 9.0544560546875
compile train time 2: 0.023819135665893554
compile train time 3: 0.021230592727661132
compile train time 4: 0.02028950309753418
compile train time 5: 0.02027724838256836
compile train time 6: 0.02025369644165039
compile train time 7: 0.020373504638671876
compile train time 8: 0.02026188850402832
compile train time 9: 0.020279296875
~~~~~~~~~~
(train) eager median: 0.046924720764160155, compile median: 0.020331503868103028, speedup: 2.3079808099083983x
~~~~~~~~~~
同样，我们可以看到 torch.compile 在第一次迭代中花费的时间更长，因为它必须编译模型，但在后续迭代中，我们看到了相对于 eager 模式的显著加速。
我们注意到，本教程中提供的加速数字仅用于演示目的。官方的加速值可以在TorchInductor 性能仪表板上查看。
与 TorchScript 和 FX Tracing 的比较¶
我们已经看到 torch.compile 可以加速 PyTorch 代码。为什么我们应该使用 torch.compile 而不是现有的 PyTorch 编译器解决方案，例如 TorchScript 或 FX Tracing？主要是因为 torch.compile 的优势在于它能够处理任意 Python 代码，并且对现有代码只需极少的改动。
torch.compile 可以处理其他编译器解决方案难以应对的一种情况是数据依赖的控制流（下方 if x.sum() < 0: 那一行）。
def f1(x, y):
if x.sum() < 0:
return -y
return y
# Test that `fn1` and `fn2` return the same result, given
# the same arguments `args`. Typically, `fn1` will be an eager function
# while `fn2` will be a compiled function (torch.compile, TorchScript, or FX graph).
def test_fns(fn1, fn2, args):
out1 = fn1(*args)
out2 = fn2(*args)
return torch.allclose(out1, out2)
inp1 = torch.randn(5, 5)
inp2 = torch.randn(5, 5)
对 f1 进行 TorchScript tracing 会导致结果默默地出错，因为只追踪了实际执行的控制流路径。
/var/lib/workspace/intermediate_source/torch_compile_tutorial.py:376: TracerWarning:
Converting a tensor to a Python boolean might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
traced 1, 1: True
traced 1, 2: False
对 f1 进行 FX tracing 会因为存在数据依赖的控制流而报错。
import traceback as tb
try:
torch.fx.symbolic_trace(f1)
except:
tb.print_exc()
Traceback (most recent call last):
File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 406, in <module>
torch.fx.symbolic_trace(f1)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/_symbolic_trace.py", line 1314, in symbolic_trace
graph = tracer.trace(root, concrete_args)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/_dynamo/eval_frame.py", line 838, in _fn
return fn(*args, **kwargs)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/_symbolic_trace.py", line 838, in trace
(self.create_arg(fn(*args)),),
File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 376, in f1
if x.sum() < 0:
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/proxy.py", line 555, in __bool__
return self.tracer.to_bool(self)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/proxy.py", line 366, in to_bool
raise TraceError(
torch.fx.proxy.TraceError: symbolically traced variables cannot be used as inputs to control flow
如果我们尝试对 f1 进行 FX tracing 时为 x 提供一个值，那么我们会遇到与 TorchScript tracing 相同的问题，因为数据依赖的控制流在追踪后的函数中被移除了。
/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/_symbolic_trace.py:913: UserWarning:
Was not able to add assertion to guarantee correct input x to specialized function. It is up to the user to make sure that your inputs match the inputs you specialized the function with.
fx 1, 1: True
fx 1, 2: False
现在我们可以看到 torch.compile 正确处理了数据依赖的控制流。
# Reset since we are using a different mode.
torch._dynamo.reset()
compile_f1 = torch.compile(f1)
print("compile 1, 1:", test_fns(f1, compile_f1, (inp1, inp2)))
print("compile 1, 2:", test_fns(f1, compile_f1, (-inp1, inp2)))
print("~" * 10)
compile 1, 1: True
compile 1, 2: True
~~~~~~~~~~
TorchScript scripting 可以处理数据依赖的控制流，但这个解决方案也有它自身的问题。也就是说，TorchScript scripting 可能需要大量的代码改动，并且在使用不支持的 Python 特性时会报错。
在下面的示例中，我们忘记了 TorchScript 类型注解，因此收到了一个 TorchScript 错误，因为参数 y 的输入类型 int 与默认参数类型 torch.Tensor 不匹配。
def f2(x, y):
return x + y
inp1 = torch.randn(5, 5)
inp2 = 3
script_f2 = torch.jit.script(f2)
try:
script_f2(inp1, inp2)
except:
tb.print_exc()
Traceback (most recent call last):
File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 449, in <module>
script_f2(inp1, inp2)
RuntimeError: f2() Expected a value of type 'Tensor (inferred)' for argument 'y' but instead found type 'int'.
Inferred 'y' to be of type 'Tensor' because it was not annotated with an explicit type.
Position: 1
Value: 3
Declaration: f2(Tensor x, Tensor y) -> Tensor
Cast error details: Unable to cast 3 to Tensor
然而，torch.compile 很容易就能处理 f2。
compile_f2 = torch.compile(f2)
print("compile 2:", test_fns(f2, compile_f2, (inp1, inp2)))
print("~" * 10)
compile 2: True
~~~~~~~~~~
torch.compile 相较于之前的编译器解决方案能很好处理的另一种情况是非 PyTorch 函数的使用。
import scipy
def f3(x):
x = x * 2
x = scipy.fft.dct(x.numpy())
x = torch.from_numpy(x)
x = x * 2
return x
TorchScript tracing 将非 PyTorch 函数调用的结果视为常量，因此我们的结果可能会默默地出错。
inp1 = torch.randn(5, 5)
inp2 = torch.randn(5, 5)
traced_f3 = torch.jit.trace(f3, (inp1,))
print("traced 3:", test_fns(f3, traced_f3, (inp2,)))
/var/lib/workspace/intermediate_source/torch_compile_tutorial.py:467: TracerWarning:
Converting a tensor to a NumPy array might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
/var/lib/workspace/intermediate_source/torch_compile_tutorial.py:468: TracerWarning:
torch.from_numpy results are registered as constants in the trace. You can safely ignore this warning if you use this function to create tensors out of constant variables that would be the same every time you call this function. In any other case, this might cause the trace to be incorrect.
traced 3: False
TorchScript scripting 和 FX tracing 不允许非 PyTorch 函数调用。
try:
torch.jit.script(f3)
except:
tb.print_exc()
try:
torch.fx.symbolic_trace(f3)
except:
tb.print_exc()
Traceback (most recent call last):
File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 485, in <module>
torch.jit.script(f3)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/jit/_script.py", line 1443, in script
ret = _script_impl(
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/jit/_script.py", line 1214, in _script_impl
fn = torch._C._jit_script_compile(
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/_jit_internal.py", line 1233, in _try_get_dispatched_fn
return boolean_dispatched.get(fn)
File "/usr/lib/python3.10/weakref.py", line 453, in get
return self.data.get(ref(key),default)
TypeError: cannot create weak reference to 'uarray._Function' object
Traceback (most recent call last):
File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 490, in <module>
torch.fx.symbolic_trace(f3)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/_symbolic_trace.py", line 1314, in symbolic_trace
graph = tracer.trace(root, concrete_args)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/_dynamo/eval_frame.py", line 838, in _fn
return fn(*args, **kwargs)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/_symbolic_trace.py", line 838, in trace
(self.create_arg(fn(*args)),),
File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 467, in f3
x = scipy.fft.dct(x.numpy())
File "/usr/local/lib/python3.10/dist-packages/scipy/fft/_backend.py", line 25, in __ua_function__
return fn(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/scipy/fft/_pocketfft/realtransforms.py", line 19, in _r2r
tmp = _asfarray(x)
File "/usr/local/lib/python3.10/dist-packages/scipy/fft/_pocketfft/helper.py", line 89, in _asfarray
if x.dtype == np.float16:
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/proxy.py", line 717, in impl
return tracer.create_proxy("call_function", target, args, kwargs)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/proxy.py", line 236, in create_proxy
args_ = self.create_arg(args)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/_symbolic_trace.py", line 428, in create_arg
return super().create_arg(a)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/proxy.py", line 311, in create_arg
return handler(self, a)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/proxy.py", line 773, in <lambda>
_create_arg_bypass[tuple] = lambda self, a: tuple([self.create_arg(elem) for elem in a])
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/proxy.py", line 773, in <listcomp>
_create_arg_bypass[tuple] = lambda self, a: tuple([self.create_arg(elem) for elem in a])
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/_symbolic_trace.py", line 428, in create_arg
return super().create_arg(a)
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/fx/proxy.py", line 357, in create_arg
raise NotImplementedError(f"argument of type: {type(a)}")
NotImplementedError: argument of type: <class 'type'>
相比之下，torch.compile 很容易就能处理非 PyTorch 函数调用。
compile_f3 = torch.compile(f3)
print("compile 3:", test_fns(f3, compile_f3, (inp2,)))
/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/_dynamo/variables/functions.py:1262: UserWarning:
Dynamo does not know how to trace the builtin `scipy.fft._pocketfft.pypocketfft.PyCapsule.dct.` This function is either a Python builtin (e.g. _warnings.warn) or a third-party C/C++ Python extension (perhaps created with pybind).
If it is a Python builtin, please file an issue on GitHub so the PyTorch team can add support for it and see the next case for a workaround.
If it is a third-party C/C++ Python extension, please either wrap it into a PyTorch-understood custom operator (see https://pytorch.ac.cn/tutorials/advanced/custom_ops_landing_page.html for more details) or, if it is traceable, use `torch.compiler.allow_in_graph`.
compile 3: True
TorchDynamo 与 FX Graphs¶
torch.compile 的一个重要组成部分是 TorchDynamo。TorchDynamo 负责将任意 Python 代码 JIT 编译成FX graphs，然后可以进一步优化这些图。TorchDynamo 通过在运行时分析 Python 字节码并检测对 PyTorch 操作的调用来提取 FX graphs。
通常，TorchInductor（torch.compile 的另一个组成部分）会进一步将 FX graphs 编译为优化的内核，但 TorchDynamo 允许使用不同的后端。为了检查 TorchDynamo 输出的 FX graphs，让我们创建一个自定义后端，该后端输出 FX graph 并简单地返回图的未优化前向方法。
from typing import List
def custom_backend(gm: torch.fx.GraphModule, example_inputs: List[torch.Tensor]):
print("custom backend called with FX graph:")
gm.graph.print_tabular()
return gm.forward
# Reset since we are using a different backend.
torch._dynamo.reset()
opt_model = torch.compile(init_model(), backend=custom_backend)
opt_model(generate_data(16)[0])
custom backend called with FX graph:
opcode name target args kwargs
------------- ----------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------
placeholder l_self_modules_features_modules_conv0_parameters_weight_ L_self_modules_features_modules_conv0_parameters_weight_ () {}
placeholder l_x_ L_x_ () {}
placeholder l_self_modules_features_modules_norm0_buffers_num_batches_tracked_ L_self_modules_features_modules_norm0_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_norm0_buffers_running_mean_ L_self_modules_features_modules_norm0_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_norm0_buffers_running_var_ L_self_modules_features_modules_norm0_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_norm0_parameters_weight_ L_self_modules_features_modules_norm0_parameters_weight_ () {}
placeholder l_self_modules_features_modules_norm0_parameters_bias_ L_self_modules_features_modules_norm0_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_transition1_modules_norm_buffers_num_batches_tracked_ L_self_modules_features_modules_transition1_modules_norm_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_transition1_modules_norm_buffers_running_mean_ L_self_modules_features_modules_transition1_modules_norm_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_transition1_modules_norm_buffers_running_var_ L_self_modules_features_modules_transition1_modules_norm_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_transition1_modules_norm_parameters_weight_ L_self_modules_features_modules_transition1_modules_norm_parameters_weight_ () {}
placeholder l_self_modules_features_modules_transition1_modules_norm_parameters_bias_ L_self_modules_features_modules_transition1_modules_norm_parameters_bias_ () {}
placeholder l_self_modules_features_modules_transition1_modules_conv_parameters_weight_ L_self_modules_features_modules_transition1_modules_conv_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_transition2_modules_norm_buffers_num_batches_tracked_ L_self_modules_features_modules_transition2_modules_norm_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_transition2_modules_norm_buffers_running_mean_ L_self_modules_features_modules_transition2_modules_norm_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_transition2_modules_norm_buffers_running_var_ L_self_modules_features_modules_transition2_modules_norm_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_transition2_modules_norm_parameters_weight_ L_self_modules_features_modules_transition2_modules_norm_parameters_weight_ () {}
placeholder l_self_modules_features_modules_transition2_modules_norm_parameters_bias_ L_self_modules_features_modules_transition2_modules_norm_parameters_bias_ () {}
placeholder l_self_modules_features_modules_transition2_modules_conv_parameters_weight_ L_self_modules_features_modules_transition2_modules_conv_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_transition3_modules_norm_buffers_num_batches_tracked_ L_self_modules_features_modules_transition3_modules_norm_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_transition3_modules_norm_buffers_running_mean_ L_self_modules_features_modules_transition3_modules_norm_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_transition3_modules_norm_buffers_running_var_ L_self_modules_features_modules_transition3_modules_norm_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_transition3_modules_norm_parameters_weight_ L_self_modules_features_modules_transition3_modules_norm_parameters_weight_ () {}
placeholder l_self_modules_features_modules_transition3_modules_norm_parameters_bias_ L_self_modules_features_modules_transition3_modules_norm_parameters_bias_ () {}
placeholder l_self_modules_features_modules_transition3_modules_conv_parameters_weight_ L_self_modules_features_modules_transition3_modules_conv_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_conv1_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_conv1_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_num_batches_tracked_ L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_running_mean_ L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_running_var_ L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_parameters_bias_ L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_parameters_bias_ () {}
placeholder l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_conv2_parameters_weight_ L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_conv2_parameters_weight_ () {}
placeholder l_self_modules_features_modules_norm5_buffers_num_batches_tracked_ L_self_modules_features_modules_norm5_buffers_num_batches_tracked_ () {}
placeholder l_self_modules_features_modules_norm5_buffers_running_mean_ L_self_modules_features_modules_norm5_buffers_running_mean_ () {}
placeholder l_self_modules_features_modules_norm5_buffers_running_var_ L_self_modules_features_modules_norm5_buffers_running_var_ () {}
placeholder l_self_modules_features_modules_norm5_parameters_weight_ L_self_modules_features_modules_norm5_parameters_weight_ () {}
placeholder l_self_modules_features_modules_norm5_parameters_bias_ L_self_modules_features_modules_norm5_parameters_bias_ () {}
placeholder l_self_modules_classifier_parameters_weight_ L_self_modules_classifier_parameters_weight_ () {}
placeholder l_self_modules_classifier_parameters_bias_ L_self_modules_classifier_parameters_bias_ () {}
call_function input_1 <built-in method conv2d of type object at 0x7f2a87cf6f40> (l_x_, l_self_modules_features_modules_conv0_parameters_weight_, None, (2, 2), (3, 3), (1, 1), 1) {}
call_method add_ add_ (l_self_modules_features_modules_norm0_buffers_num_batches_tracked_, 1) {}
call_function input_2 <function batch_norm at 0x7f2994f6beb0> (input_1, l_self_modules_features_modules_norm0_buffers_running_mean_, l_self_modules_features_modules_norm0_buffers_running_var_, l_self_modules_features_modules_norm0_parameters_weight_, l_self_modules_features_modules_norm0_parameters_bias_, True, 0.1, 1e-05) {}
call_function input_3 <function relu at 0x7f2994f6aef0> (input_2,) {'inplace': True}
call_function input_4 <function boolean_dispatch.<locals>.fn at 0x7f2994f69cf0> (input_3, 3, 2, 1, 1) {'ceil_mode': False, 'return_indices': False}
call_function concated_features <built-in method cat of type object at 0x7f2a87cf6f40> ([input_4], 1) {}
call_method add__1 add_ (l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_1 <function batch_norm at 0x7f2994f6beb0> (concated_features, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_1 <function relu at 0x7f2994f6aef0> (batch_norm_1,) {'inplace': True}
call_function bottleneck_output <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_1, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__2 add_ (l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_2 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_2 <function relu at 0x7f2994f6aef0> (batch_norm_2,) {'inplace': True}
call_function new_features <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_2, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_1 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_4, new_features], 1) {}
call_method add__3 add_ (l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_3 <function batch_norm at 0x7f2994f6beb0> (concated_features_1, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_3 <function relu at 0x7f2994f6aef0> (batch_norm_3,) {'inplace': True}
call_function bottleneck_output_1 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_3, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__4 add_ (l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_4 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_1, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_4 <function relu at 0x7f2994f6aef0> (batch_norm_4,) {'inplace': True}
call_function new_features_1 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_4, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_2 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_4, new_features, new_features_1], 1) {}
call_method add__5 add_ (l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_5 <function batch_norm at 0x7f2994f6beb0> (concated_features_2, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_5 <function relu at 0x7f2994f6aef0> (batch_norm_5,) {'inplace': True}
call_function bottleneck_output_2 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_5, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__6 add_ (l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_6 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_2, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_6 <function relu at 0x7f2994f6aef0> (batch_norm_6,) {'inplace': True}
call_function new_features_2 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_6, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_3 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_4, new_features, new_features_1, new_features_2], 1) {}
call_method add__7 add_ (l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_7 <function batch_norm at 0x7f2994f6beb0> (concated_features_3, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_7 <function relu at 0x7f2994f6aef0> (batch_norm_7,) {'inplace': True}
call_function bottleneck_output_3 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_7, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__8 add_ (l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_8 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_3, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_8 <function relu at 0x7f2994f6aef0> (batch_norm_8,) {'inplace': True}
call_function new_features_3 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_8, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_4 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_4, new_features, new_features_1, new_features_2, new_features_3], 1) {}
call_method add__9 add_ (l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_9 <function batch_norm at 0x7f2994f6beb0> (concated_features_4, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_9 <function relu at 0x7f2994f6aef0> (batch_norm_9,) {'inplace': True}
call_function bottleneck_output_4 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_9, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__10 add_ (l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_10 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_4, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_10 <function relu at 0x7f2994f6aef0> (batch_norm_10,) {'inplace': True}
call_function new_features_4 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_10, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_5 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_4, new_features, new_features_1, new_features_2, new_features_3, new_features_4], 1) {}
call_method add__11 add_ (l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_11 <function batch_norm at 0x7f2994f6beb0> (concated_features_5, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_11 <function relu at 0x7f2994f6aef0> (batch_norm_11,) {'inplace': True}
call_function bottleneck_output_5 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_11, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__12 add_ (l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_12 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_5, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_12 <function relu at 0x7f2994f6aef0> (batch_norm_12,) {'inplace': True}
call_function new_features_5 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_12, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function input_5 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_4, new_features, new_features_1, new_features_2, new_features_3, new_features_4, new_features_5], 1) {}
call_method add__13 add_ (l_self_modules_features_modules_transition1_modules_norm_buffers_num_batches_tracked_, 1) {}
call_function input_6 <function batch_norm at 0x7f2994f6beb0> (input_5, l_self_modules_features_modules_transition1_modules_norm_buffers_running_mean_, l_self_modules_features_modules_transition1_modules_norm_buffers_running_var_, l_self_modules_features_modules_transition1_modules_norm_parameters_weight_, l_self_modules_features_modules_transition1_modules_norm_parameters_bias_, True, 0.1, 1e-05) {}
call_function input_7 <function relu at 0x7f2994f6aef0> (input_6,) {'inplace': True}
call_function input_8 <built-in method conv2d of type object at 0x7f2a87cf6f40> (input_7, l_self_modules_features_modules_transition1_modules_conv_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_function input_9 <built-in function avg_pool2d> (input_8, 2, 2, 0, False, True, None) {}
call_function concated_features_6 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9], 1) {}
call_method add__14 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_14 <function batch_norm at 0x7f2994f6beb0> (concated_features_6, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_14 <function relu at 0x7f2994f6aef0> (batch_norm_14,) {'inplace': True}
call_function bottleneck_output_6 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_14, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__15 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_15 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_6, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_15 <function relu at 0x7f2994f6aef0> (batch_norm_15,) {'inplace': True}
call_function new_features_6 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_15, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_7 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9, new_features_6], 1) {}
call_method add__16 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_16 <function batch_norm at 0x7f2994f6beb0> (concated_features_7, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_16 <function relu at 0x7f2994f6aef0> (batch_norm_16,) {'inplace': True}
call_function bottleneck_output_7 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_16, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__17 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_17 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_7, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_17 <function relu at 0x7f2994f6aef0> (batch_norm_17,) {'inplace': True}
call_function new_features_7 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_17, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_8 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9, new_features_6, new_features_7], 1) {}
call_method add__18 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_18 <function batch_norm at 0x7f2994f6beb0> (concated_features_8, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_18 <function relu at 0x7f2994f6aef0> (batch_norm_18,) {'inplace': True}
call_function bottleneck_output_8 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_18, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__19 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_19 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_8, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_19 <function relu at 0x7f2994f6aef0> (batch_norm_19,) {'inplace': True}
call_function new_features_8 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_19, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_9 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9, new_features_6, new_features_7, new_features_8], 1) {}
call_method add__20 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_20 <function batch_norm at 0x7f2994f6beb0> (concated_features_9, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_20 <function relu at 0x7f2994f6aef0> (batch_norm_20,) {'inplace': True}
call_function bottleneck_output_9 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_20, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__21 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_21 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_9, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_21 <function relu at 0x7f2994f6aef0> (batch_norm_21,) {'inplace': True}
call_function new_features_9 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_21, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_10 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9, new_features_6, new_features_7, new_features_8, new_features_9], 1) {}
call_method add__22 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_22 <function batch_norm at 0x7f2994f6beb0> (concated_features_10, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_22 <function relu at 0x7f2994f6aef0> (batch_norm_22,) {'inplace': True}
call_function bottleneck_output_10 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_22, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__23 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_23 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_10, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_23 <function relu at 0x7f2994f6aef0> (batch_norm_23,) {'inplace': True}
call_function new_features_10 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_23, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_11 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10], 1) {}
call_method add__24 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_24 <function batch_norm at 0x7f2994f6beb0> (concated_features_11, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_24 <function relu at 0x7f2994f6aef0> (batch_norm_24,) {'inplace': True}
call_function bottleneck_output_11 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_24, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__25 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_25 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_11, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_25 <function relu at 0x7f2994f6aef0> (batch_norm_25,) {'inplace': True}
call_function new_features_11 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_25, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_12 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11], 1) {}
call_method add__26 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_26 <function batch_norm at 0x7f2994f6beb0> (concated_features_12, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_26 <function relu at 0x7f2994f6aef0> (batch_norm_26,) {'inplace': True}
call_function bottleneck_output_12 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_26, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__27 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_27 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_12, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_27 <function relu at 0x7f2994f6aef0> (batch_norm_27,) {'inplace': True}
call_function new_features_12 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_27, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_13 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11, new_features_12], 1) {}
call_method add__28 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_28 <function batch_norm at 0x7f2994f6beb0> (concated_features_13, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_28 <function relu at 0x7f2994f6aef0> (batch_norm_28,) {'inplace': True}
call_function bottleneck_output_13 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_28, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__29 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_29 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_13, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_29 <function relu at 0x7f2994f6aef0> (batch_norm_29,) {'inplace': True}
call_function new_features_13 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_29, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_14 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11, new_features_12, new_features_13], 1) {}
call_method add__30 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_30 <function batch_norm at 0x7f2994f6beb0> (concated_features_14, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_30 <function relu at 0x7f2994f6aef0> (batch_norm_30,) {'inplace': True}
call_function bottleneck_output_14 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_30, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__31 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_31 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_14, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_31 <function relu at 0x7f2994f6aef0> (batch_norm_31,) {'inplace': True}
call_function new_features_14 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_31, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_15 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11, new_features_12, new_features_13, new_features_14], 1) {}
call_method add__32 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_32 <function batch_norm at 0x7f2994f6beb0> (concated_features_15, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_32 <function relu at 0x7f2994f6aef0> (batch_norm_32,) {'inplace': True}
call_function bottleneck_output_15 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_32, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__33 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_33 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_15, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_33 <function relu at 0x7f2994f6aef0> (batch_norm_33,) {'inplace': True}
call_function new_features_15 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_33, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_16 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11, new_features_12, new_features_13, new_features_14, new_features_15], 1) {}
call_method add__34 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_34 <function batch_norm at 0x7f2994f6beb0> (concated_features_16, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_34 <function relu at 0x7f2994f6aef0> (batch_norm_34,) {'inplace': True}
call_function bottleneck_output_16 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_34, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__35 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_35 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_16, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_35 <function relu at 0x7f2994f6aef0> (batch_norm_35,) {'inplace': True}
call_function new_features_16 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_35, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_17 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11, new_features_12, new_features_13, new_features_14, new_features_15, new_features_16], 1) {}
call_method add__36 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_36 <function batch_norm at 0x7f2994f6beb0> (concated_features_17, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_36 <function relu at 0x7f2994f6aef0> (batch_norm_36,) {'inplace': True}
call_function bottleneck_output_17 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_36, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__37 add_ (l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_37 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_17, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_37 <function relu at 0x7f2994f6aef0> (batch_norm_37,) {'inplace': True}
call_function new_features_17 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_37, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function input_10 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11, new_features_12, new_features_13, new_features_14, new_features_15, new_features_16, new_features_17], 1) {}
call_method add__38 add_ (l_self_modules_features_modules_transition2_modules_norm_buffers_num_batches_tracked_, 1) {}
call_function input_11 <function batch_norm at 0x7f2994f6beb0> (input_10, l_self_modules_features_modules_transition2_modules_norm_buffers_running_mean_, l_self_modules_features_modules_transition2_modules_norm_buffers_running_var_, l_self_modules_features_modules_transition2_modules_norm_parameters_weight_, l_self_modules_features_modules_transition2_modules_norm_parameters_bias_, True, 0.1, 1e-05) {}
call_function input_12 <function relu at 0x7f2994f6aef0> (input_11,) {'inplace': True}
call_function input_13 <built-in method conv2d of type object at 0x7f2a87cf6f40> (input_12, l_self_modules_features_modules_transition2_modules_conv_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_function input_14 <built-in function avg_pool2d> (input_13, 2, 2, 0, False, True, None) {}
call_function concated_features_18 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14], 1) {}
call_method add__39 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_39 <function batch_norm at 0x7f2994f6beb0> (concated_features_18, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_39 <function relu at 0x7f2994f6aef0> (batch_norm_39,) {'inplace': True}
call_function bottleneck_output_18 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_39, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__40 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_40 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_18, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_40 <function relu at 0x7f2994f6aef0> (batch_norm_40,) {'inplace': True}
call_function new_features_18 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_40, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_19 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18], 1) {}
call_method add__41 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_41 <function batch_norm at 0x7f2994f6beb0> (concated_features_19, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_41 <function relu at 0x7f2994f6aef0> (batch_norm_41,) {'inplace': True}
call_function bottleneck_output_19 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_41, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__42 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_42 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_19, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_42 <function relu at 0x7f2994f6aef0> (batch_norm_42,) {'inplace': True}
call_function new_features_19 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_42, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_20 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19], 1) {}
call_method add__43 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_43 <function batch_norm at 0x7f2994f6beb0> (concated_features_20, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_43 <function relu at 0x7f2994f6aef0> (batch_norm_43,) {'inplace': True}
call_function bottleneck_output_20 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_43, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__44 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_44 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_20, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_44 <function relu at 0x7f2994f6aef0> (batch_norm_44,) {'inplace': True}
call_function new_features_20 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_44, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_21 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20], 1) {}
call_method add__45 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_45 <function batch_norm at 0x7f2994f6beb0> (concated_features_21, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_45 <function relu at 0x7f2994f6aef0> (batch_norm_45,) {'inplace': True}
call_function bottleneck_output_21 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_45, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__46 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_46 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_21, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_46 <function relu at 0x7f2994f6aef0> (batch_norm_46,) {'inplace': True}
call_function new_features_21 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_46, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_22 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21], 1) {}
call_method add__47 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_47 <function batch_norm at 0x7f2994f6beb0> (concated_features_22, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_47 <function relu at 0x7f2994f6aef0> (batch_norm_47,) {'inplace': True}
call_function bottleneck_output_22 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_47, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__48 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_48 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_22, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_48 <function relu at 0x7f2994f6aef0> (batch_norm_48,) {'inplace': True}
call_function new_features_22 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_48, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_23 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22], 1) {}
call_method add__49 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_49 <function batch_norm at 0x7f2994f6beb0> (concated_features_23, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_49 <function relu at 0x7f2994f6aef0> (batch_norm_49,) {'inplace': True}
call_function bottleneck_output_23 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_49, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__50 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_50 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_23, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_50 <function relu at 0x7f2994f6aef0> (batch_norm_50,) {'inplace': True}
call_function new_features_23 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_50, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_24 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23], 1) {}
call_method add__51 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_51 <function batch_norm at 0x7f2994f6beb0> (concated_features_24, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_51 <function relu at 0x7f2994f6aef0> (batch_norm_51,) {'inplace': True}
call_function bottleneck_output_24 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_51, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__52 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_52 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_24, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_52 <function relu at 0x7f2994f6aef0> (batch_norm_52,) {'inplace': True}
call_function new_features_24 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_52, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_25 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24], 1) {}
call_method add__53 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_53 <function batch_norm at 0x7f2994f6beb0> (concated_features_25, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_53 <function relu at 0x7f2994f6aef0> (batch_norm_53,) {'inplace': True}
call_function bottleneck_output_25 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_53, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__54 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_54 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_25, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_54 <function relu at 0x7f2994f6aef0> (batch_norm_54,) {'inplace': True}
call_function new_features_25 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_54, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_26 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25], 1) {}
call_method add__55 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_55 <function batch_norm at 0x7f2994f6beb0> (concated_features_26, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_55 <function relu at 0x7f2994f6aef0> (batch_norm_55,) {'inplace': True}
call_function bottleneck_output_26 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_55, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__56 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_56 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_26, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_56 <function relu at 0x7f2994f6aef0> (batch_norm_56,) {'inplace': True}
call_function new_features_26 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_56, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_27 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26], 1) {}
call_method add__57 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_57 <function batch_norm at 0x7f2994f6beb0> (concated_features_27, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_57 <function relu at 0x7f2994f6aef0> (batch_norm_57,) {'inplace': True}
call_function bottleneck_output_27 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_57, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__58 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_58 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_27, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_58 <function relu at 0x7f2994f6aef0> (batch_norm_58,) {'inplace': True}
call_function new_features_27 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_58, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_28 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27], 1) {}
call_method add__59 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_59 <function batch_norm at 0x7f2994f6beb0> (concated_features_28, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_59 <function relu at 0x7f2994f6aef0> (batch_norm_59,) {'inplace': True}
call_function bottleneck_output_28 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_59, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__60 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_60 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_28, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_60 <function relu at 0x7f2994f6aef0> (batch_norm_60,) {'inplace': True}
call_function new_features_28 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_60, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_29 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28], 1) {}
call_method add__61 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_61 <function batch_norm at 0x7f2994f6beb0> (concated_features_29, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_61 <function relu at 0x7f2994f6aef0> (batch_norm_61,) {'inplace': True}
call_function bottleneck_output_29 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_61, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__62 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_62 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_29, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_62 <function relu at 0x7f2994f6aef0> (batch_norm_62,) {'inplace': True}
call_function new_features_29 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_62, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_30 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29], 1) {}
call_method add__63 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_63 <function batch_norm at 0x7f2994f6beb0> (concated_features_30, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_63 <function relu at 0x7f2994f6aef0> (batch_norm_63,) {'inplace': True}
call_function bottleneck_output_30 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_63, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__64 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_64 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_30, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_64 <function relu at 0x7f2994f6aef0> (batch_norm_64,) {'inplace': True}
call_function new_features_30 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_64, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_31 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30], 1) {}
call_method add__65 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_65 <function batch_norm at 0x7f2994f6beb0> (concated_features_31, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_65 <function relu at 0x7f2994f6aef0> (batch_norm_65,) {'inplace': True}
call_function bottleneck_output_31 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_65, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__66 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_66 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_31, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_66 <function relu at 0x7f2994f6aef0> (batch_norm_66,) {'inplace': True}
call_function new_features_31 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_66, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_32 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31], 1) {}
call_method add__67 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_67 <function batch_norm at 0x7f2994f6beb0> (concated_features_32, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_67 <function relu at 0x7f2994f6aef0> (batch_norm_67,) {'inplace': True}
call_function bottleneck_output_32 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_67, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__68 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_68 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_32, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_68 <function relu at 0x7f2994f6aef0> (batch_norm_68,) {'inplace': True}
call_function new_features_32 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_68, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_33 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32], 1) {}
call_method add__69 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_69 <function batch_norm at 0x7f2994f6beb0> (concated_features_33, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_69 <function relu at 0x7f2994f6aef0> (batch_norm_69,) {'inplace': True}
call_function bottleneck_output_33 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_69, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__70 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_70 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_33, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_70 <function relu at 0x7f2994f6aef0> (batch_norm_70,) {'inplace': True}
call_function new_features_33 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_70, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_34 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33], 1) {}
call_method add__71 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_71 <function batch_norm at 0x7f2994f6beb0> (concated_features_34, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_71 <function relu at 0x7f2994f6aef0> (batch_norm_71,) {'inplace': True}
call_function bottleneck_output_34 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_71, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__72 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_72 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_34, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_72 <function relu at 0x7f2994f6aef0> (batch_norm_72,) {'inplace': True}
call_function new_features_34 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_72, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_35 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34], 1) {}
call_method add__73 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_73 <function batch_norm at 0x7f2994f6beb0> (concated_features_35, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_73 <function relu at 0x7f2994f6aef0> (batch_norm_73,) {'inplace': True}
call_function bottleneck_output_35 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_73, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__74 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_74 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_35, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_74 <function relu at 0x7f2994f6aef0> (batch_norm_74,) {'inplace': True}
call_function new_features_35 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_74, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_36 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35], 1) {}
call_method add__75 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_75 <function batch_norm at 0x7f2994f6beb0> (concated_features_36, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_75 <function relu at 0x7f2994f6aef0> (batch_norm_75,) {'inplace': True}
call_function bottleneck_output_36 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_75, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__76 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_76 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_36, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_76 <function relu at 0x7f2994f6aef0> (batch_norm_76,) {'inplace': True}
call_function new_features_36 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_76, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_37 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35, new_features_36], 1) {}
call_method add__77 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_77 <function batch_norm at 0x7f2994f6beb0> (concated_features_37, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_77 <function relu at 0x7f2994f6aef0> (batch_norm_77,) {'inplace': True}
call_function bottleneck_output_37 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_77, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__78 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_78 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_37, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_78 <function relu at 0x7f2994f6aef0> (batch_norm_78,) {'inplace': True}
call_function new_features_37 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_78, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_38 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35, new_features_36, new_features_37], 1) {}
call_method add__79 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_79 <function batch_norm at 0x7f2994f6beb0> (concated_features_38, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_79 <function relu at 0x7f2994f6aef0> (batch_norm_79,) {'inplace': True}
call_function bottleneck_output_38 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_79, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__80 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_80 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_38, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_80 <function relu at 0x7f2994f6aef0> (batch_norm_80,) {'inplace': True}
call_function new_features_38 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_80, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_39 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35, new_features_36, new_features_37, new_features_38], 1) {}
call_method add__81 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_81 <function batch_norm at 0x7f2994f6beb0> (concated_features_39, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_81 <function relu at 0x7f2994f6aef0> (batch_norm_81,) {'inplace': True}
call_function bottleneck_output_39 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_81, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__82 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_82 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_39, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_82 <function relu at 0x7f2994f6aef0> (batch_norm_82,) {'inplace': True}
call_function new_features_39 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_82, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_40 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35, new_features_36, new_features_37, new_features_38, new_features_39], 1) {}
call_method add__83 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_83 <function batch_norm at 0x7f2994f6beb0> (concated_features_40, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_83 <function relu at 0x7f2994f6aef0> (batch_norm_83,) {'inplace': True}
call_function bottleneck_output_40 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_83, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__84 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_84 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_40, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_84 <function relu at 0x7f2994f6aef0> (batch_norm_84,) {'inplace': True}
call_function new_features_40 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_84, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_41 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35, new_features_36, new_features_37, new_features_38, new_features_39, new_features_40], 1) {}
call_method add__85 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_85 <function batch_norm at 0x7f2994f6beb0> (concated_features_41, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_85 <function relu at 0x7f2994f6aef0> (batch_norm_85,) {'inplace': True}
call_function bottleneck_output_41 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_85, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__86 add_ (l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_86 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_41, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_86 <function relu at 0x7f2994f6aef0> (batch_norm_86,) {'inplace': True}
call_function new_features_41 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_86, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function input_15 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35, new_features_36, new_features_37, new_features_38, new_features_39, new_features_40, new_features_41], 1) {}
call_method add__87 add_ (l_self_modules_features_modules_transition3_modules_norm_buffers_num_batches_tracked_, 1) {}
call_function input_16 <function batch_norm at 0x7f2994f6beb0> (input_15, l_self_modules_features_modules_transition3_modules_norm_buffers_running_mean_, l_self_modules_features_modules_transition3_modules_norm_buffers_running_var_, l_self_modules_features_modules_transition3_modules_norm_parameters_weight_, l_self_modules_features_modules_transition3_modules_norm_parameters_bias_, True, 0.1, 1e-05) {}
call_function input_17 <function relu at 0x7f2994f6aef0> (input_16,) {'inplace': True}
call_function input_18 <built-in method conv2d of type object at 0x7f2a87cf6f40> (input_17, l_self_modules_features_modules_transition3_modules_conv_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_function input_19 <built-in function avg_pool2d> (input_18, 2, 2, 0, False, True, None) {}
call_function concated_features_42 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19], 1) {}
call_method add__88 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_88 <function batch_norm at 0x7f2994f6beb0> (concated_features_42, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_88 <function relu at 0x7f2994f6aef0> (batch_norm_88,) {'inplace': True}
call_function bottleneck_output_42 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_88, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__89 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_89 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_42, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_89 <function relu at 0x7f2994f6aef0> (batch_norm_89,) {'inplace': True}
call_function new_features_42 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_89, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_43 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42], 1) {}
call_method add__90 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_90 <function batch_norm at 0x7f2994f6beb0> (concated_features_43, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_90 <function relu at 0x7f2994f6aef0> (batch_norm_90,) {'inplace': True}
call_function bottleneck_output_43 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_90, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__91 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_91 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_43, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_91 <function relu at 0x7f2994f6aef0> (batch_norm_91,) {'inplace': True}
call_function new_features_43 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_91, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_44 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43], 1) {}
call_method add__92 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_92 <function batch_norm at 0x7f2994f6beb0> (concated_features_44, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_92 <function relu at 0x7f2994f6aef0> (batch_norm_92,) {'inplace': True}
call_function bottleneck_output_44 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_92, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__93 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_93 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_44, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_93 <function relu at 0x7f2994f6aef0> (batch_norm_93,) {'inplace': True}
call_function new_features_44 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_93, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_45 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44], 1) {}
call_method add__94 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_94 <function batch_norm at 0x7f2994f6beb0> (concated_features_45, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_94 <function relu at 0x7f2994f6aef0> (batch_norm_94,) {'inplace': True}
call_function bottleneck_output_45 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_94, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__95 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_95 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_45, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_95 <function relu at 0x7f2994f6aef0> (batch_norm_95,) {'inplace': True}
call_function new_features_45 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_95, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_46 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45], 1) {}
call_method add__96 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_96 <function batch_norm at 0x7f2994f6beb0> (concated_features_46, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_96 <function relu at 0x7f2994f6aef0> (batch_norm_96,) {'inplace': True}
call_function bottleneck_output_46 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_96, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__97 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_97 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_46, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_97 <function relu at 0x7f2994f6aef0> (batch_norm_97,) {'inplace': True}
call_function new_features_46 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_97, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_47 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46], 1) {}
call_method add__98 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_98 <function batch_norm at 0x7f2994f6beb0> (concated_features_47, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_98 <function relu at 0x7f2994f6aef0> (batch_norm_98,) {'inplace': True}
call_function bottleneck_output_47 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_98, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__99 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_99 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_47, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_99 <function relu at 0x7f2994f6aef0> (batch_norm_99,) {'inplace': True}
call_function new_features_47 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_99, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_48 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47], 1) {}
call_method add__100 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_100 <function batch_norm at 0x7f2994f6beb0> (concated_features_48, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_100 <function relu at 0x7f2994f6aef0> (batch_norm_100,) {'inplace': True}
call_function bottleneck_output_48 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_100, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__101 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_101 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_48, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_101 <function relu at 0x7f2994f6aef0> (batch_norm_101,) {'inplace': True}
call_function new_features_48 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_101, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_49 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48], 1) {}
call_method add__102 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_102 <function batch_norm at 0x7f2994f6beb0> (concated_features_49, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_102 <function relu at 0x7f2994f6aef0> (batch_norm_102,) {'inplace': True}
call_function bottleneck_output_49 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_102, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__103 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_103 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_49, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_103 <function relu at 0x7f2994f6aef0> (batch_norm_103,) {'inplace': True}
call_function new_features_49 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_103, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_50 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49], 1) {}
call_method add__104 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_104 <function batch_norm at 0x7f2994f6beb0> (concated_features_50, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_104 <function relu at 0x7f2994f6aef0> (batch_norm_104,) {'inplace': True}
call_function bottleneck_output_50 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_104, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__105 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_105 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_50, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_105 <function relu at 0x7f2994f6aef0> (batch_norm_105,) {'inplace': True}
call_function new_features_50 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_105, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_51 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50], 1) {}
call_method add__106 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_106 <function batch_norm at 0x7f2994f6beb0> (concated_features_51, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_106 <function relu at 0x7f2994f6aef0> (batch_norm_106,) {'inplace': True}
call_function bottleneck_output_51 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_106, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__107 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_107 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_51, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_107 <function relu at 0x7f2994f6aef0> (batch_norm_107,) {'inplace': True}
call_function new_features_51 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_107, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_52 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51], 1) {}
call_method add__108 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_108 <function batch_norm at 0x7f2994f6beb0> (concated_features_52, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_108 <function relu at 0x7f2994f6aef0> (batch_norm_108,) {'inplace': True}
call_function bottleneck_output_52 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_108, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__109 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_109 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_52, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_109 <function relu at 0x7f2994f6aef0> (batch_norm_109,) {'inplace': True}
call_function new_features_52 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_109, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_53 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51, new_features_52], 1) {}
call_method add__110 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_110 <function batch_norm at 0x7f2994f6beb0> (concated_features_53, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_110 <function relu at 0x7f2994f6aef0> (batch_norm_110,) {'inplace': True}
call_function bottleneck_output_53 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_110, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__111 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_111 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_53, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_111 <function relu at 0x7f2994f6aef0> (batch_norm_111,) {'inplace': True}
call_function new_features_53 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_111, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_54 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51, new_features_52, new_features_53], 1) {}
call_method add__112 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_112 <function batch_norm at 0x7f2994f6beb0> (concated_features_54, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_112 <function relu at 0x7f2994f6aef0> (batch_norm_112,) {'inplace': True}
call_function bottleneck_output_54 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_112, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__113 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_113 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_54, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_113 <function relu at 0x7f2994f6aef0> (batch_norm_113,) {'inplace': True}
call_function new_features_54 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_113, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_55 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51, new_features_52, new_features_53, new_features_54], 1) {}
call_method add__114 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_114 <function batch_norm at 0x7f2994f6beb0> (concated_features_55, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_114 <function relu at 0x7f2994f6aef0> (batch_norm_114,) {'inplace': True}
call_function bottleneck_output_55 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_114, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__115 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_115 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_55, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_115 <function relu at 0x7f2994f6aef0> (batch_norm_115,) {'inplace': True}
call_function new_features_55 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_115, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_56 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51, new_features_52, new_features_53, new_features_54, new_features_55], 1) {}
call_method add__116 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_116 <function batch_norm at 0x7f2994f6beb0> (concated_features_56, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_116 <function relu at 0x7f2994f6aef0> (batch_norm_116,) {'inplace': True}
call_function bottleneck_output_56 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_116, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__117 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_117 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_56, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_117 <function relu at 0x7f2994f6aef0> (batch_norm_117,) {'inplace': True}
call_function new_features_56 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_117, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function concated_features_57 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51, new_features_52, new_features_53, new_features_54, new_features_55, new_features_56], 1) {}
call_method add__118 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_118 <function batch_norm at 0x7f2994f6beb0> (concated_features_57, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_118 <function relu at 0x7f2994f6aef0> (batch_norm_118,) {'inplace': True}
call_function bottleneck_output_57 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_118, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1) {}
call_method add__119 add_ (l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_num_batches_tracked_, 1) {}
call_function batch_norm_119 <function batch_norm at 0x7f2994f6beb0> (bottleneck_output_57, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_parameters_bias_, True, 0.1, 1e-05) {}
call_function relu_119 <function relu at 0x7f2994f6aef0> (batch_norm_119,) {'inplace': True}
call_function new_features_57 <built-in method conv2d of type object at 0x7f2a87cf6f40> (relu_119, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1) {}
call_function input_20 <built-in method cat of type object at 0x7f2a87cf6f40> ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51, new_features_52, new_features_53, new_features_54, new_features_55, new_features_56, new_features_57], 1) {}
call_method add__120 add_ (l_self_modules_features_modules_norm5_buffers_num_batches_tracked_, 1) {}
call_function input_21 <function batch_norm at 0x7f2994f6beb0> (input_20, l_self_modules_features_modules_norm5_buffers_running_mean_, l_self_modules_features_modules_norm5_buffers_running_var_, l_self_modules_features_modules_norm5_parameters_weight_, l_self_modules_features_modules_norm5_parameters_bias_, True, 0.1, 1e-05) {}
call_function out <function relu at 0x7f2994f6aef0> (input_21,) {'inplace': True}
call_function out_1 <function adaptive_avg_pool2d at 0x7f2994f6a9e0> (out, (1, 1)) {}
call_function out_2 <built-in method flatten of type object at 0x7f2a87cf6f40> (out_1, 1) {}
call_function out_3 <built-in function linear> (out_2, l_self_modules_classifier_parameters_weight_, l_self_modules_classifier_parameters_bias_) {}
output output output ((out_3,),) {}
tensor([[-0.2419, -0.1561, -0.5038, ..., 0.0502, 0.0782, -0.2082],
[-0.2148, -0.2957, -0.4718, ..., 0.0412, 0.0320, -0.2365],
[-0.2176, -0.3723, -0.3055, ..., 0.1889, 0.0048, -0.1922],
...,
[-0.2986, -0.1021, -0.5949, ..., 0.3604, -0.2926, -0.1095],
[-0.2935, -0.0462, -0.4530, ..., 0.0395, -0.0908, -0.2317],
[-0.1438, 0.0546, -0.4445, ..., 0.1843, -0.1576, -0.2855]],
device='cuda:0', grad_fn=<AddmmBackward0>)
使用我们的自定义后端，我们现在可以看到 TorchDynamo 如何处理数据依赖的控制流。考虑下面的函数，其中 if b.sum() < 0 这一行是数据依赖控制流的来源。
def bar(a, b):
x = a / (torch.abs(a) + 1)
if b.sum() < 0:
b = b * -1
return x * b
opt_bar = torch.compile(bar, backend=custom_backend)
inp1 = torch.randn(10)
inp2 = torch.randn(10)
opt_bar(inp1, inp2)
opt_bar(inp1, -inp2)
custom backend called with FX graph:
opcode name target args kwargs
------------- ------ ------------------------------------------------------ ----------- --------
placeholder l_a_ L_a_ () {}
placeholder l_b_ L_b_ () {}
call_function abs_1 <built-in method abs of type object at 0x7f2a87cf6f40> (l_a_,) {}
call_function add <built-in function add> (abs_1, 1) {}
call_function x <built-in function truediv> (l_a_, add) {}
call_method sum_1 sum (l_b_,) {}
call_function lt <built-in function lt> (sum_1, 0) {}
output output output ((x, lt),) {}
custom backend called with FX graph:
opcode name target args kwargs
------------- ------ ----------------------- ------------ --------
placeholder l_x_ L_x_ () {}
placeholder l_b_ L_b_ () {}
call_function mul <built-in function mul> (l_x_, l_b_) {}
output output output ((mul,),) {}
custom backend called with FX graph:
opcode name target args kwargs
------------- ------ ----------------------- ----------- --------
placeholder l_b_ L_b_ () {}
placeholder l_x_ L_x_ () {}
call_function b <built-in function mul> (l_b_, -1) {}
call_function mul_1 <built-in function mul> (l_x_, b) {}
output output output ((mul_1,),) {}
tensor([-0.1181, 0.1225, 0.2214, -0.0173, -0.7982, 0.6274, -0.4151, -0.9775,
-0.2735, 1.0795])
输出显示 TorchDynamo 提取了 3 个不同的 FX graphs，对应于以下代码（顺序可能与上面的输出不同）
x = a / (torch.abs(a) + 1)b = b * -1; return x * breturn x * b
当 TorchDynamo 遇到不支持的 Python 特性（例如数据依赖的控制流）时，它会中断计算图的捕获，让默认的 Python 解释器处理不支持的代码，然后恢复捕获图。
让我们通过一个例子来研究 TorchDynamo 如何执行 bar。如果 b.sum() < 0，那么 TorchDynamo 将运行图 1，让 Python 确定条件的结果，然后运行图 2。另一方面，如果 not b.sum() < 0，那么 TorchDynamo 将运行图 1，让 Python 确定条件的结果，然后运行图 3。
这突出显示了 TorchDynamo 与之前 PyTorch 编译器解决方案之间的一个主要区别。当遇到不支持的 Python 特性时，之前的解决方案要么报错，要么默默地失败。另一方面，TorchDynamo 会中断计算图的捕获。
我们可以使用 torch._dynamo.explain 查看 TorchDynamo 在哪里中断了图的捕获。
# Reset since we are using a different backend.
torch._dynamo.reset()
explain_output = torch._dynamo.explain(bar)(torch.randn(10), torch.randn(10))
print(explain_output)
Graph Count: 2
Graph Break Count: 1
Op Count: 6
Break Reasons:
Break Reason 1:
Reason: generic_jump TensorVariable()
User Stack:
<FrameSummary file /var/lib/workspace/intermediate_source/torch_compile_tutorial.py, line 536 in bar>
Ops per Graph:
Ops 1:
<built-in method abs of type object at 0x7f2a87cf6f40>
<built-in function add>
<built-in function truediv>
<built-in function lt>
Ops 2:
<built-in function mul>
<built-in function mul>
Out Guards:
Guard 1:
Name: ''
Source: shape_env
Create Function: SHAPE_ENV
Guard Types: None
Code List: None
Object Weakref: None
Guarded Class Weakref: None
Guard 2:
Name: ''
Source: global
Create Function: TORCH_FUNCTION_STATE
Guard Types: None
Code List: None
Object Weakref: None
Guarded Class Weakref: None
Guard 3:
Name: "L['b'].sum"
Source: local
Create Function: HASATTR
Guard Types: ['HASATTR']
Code List: ["hasattr(L['b'], 'sum')"]
Object Weakref: <weakref at 0x7f28b35e3830; dead>
Guarded Class Weakref: <weakref at 0x7f29f4f93060; to 'torch._C._TensorMeta' at 0x5620fe8b6960 (Tensor)>
Guard 4:
Name: "G['torch'].abs"
Source: global
Create Function: FUNCTION_MATCH
Guard Types: ['ID_MATCH']
Code List: ["___check_obj_id(G['torch'].abs, 139820775344864)"]
Object Weakref: <weakref at 0x7f28ab7724d0; to 'builtin_function_or_method' at 0x7f2a8fa58ae0>
Guarded Class Weakref: <weakref at 0x7f2a91361cb0; to 'type' at 0x5620ea4d08a0 (builtin_function_or_method)>
Guard 5:
Name: "G['torch']"
Source: global
Create Function: FUNCTION_MATCH
Guard Types: ['ID_MATCH']
Code List: ["___check_obj_id(G['torch'], 139820776259184)"]
Object Weakref: <weakref at 0x7f28f884e1b0; to 'module' at 0x7f2a8fb37e70>
Guarded Class Weakref: <weakref at 0x7f2a9138b1a0; to 'type' at 0x5620ea4da0a0 (module)>
Guard 6:
Name: ''
Source: global
Create Function: DEFAULT_DEVICE
Guard Types: ['DEFAULT_DEVICE']
Code List: ['utils_device.CURRENT_DEVICE == None']
Object Weakref: None
Guarded Class Weakref: None
Guard 7:
Name: "L['a']"
Source: local
Create Function: TENSOR_MATCH
Guard Types: ['TENSOR_MATCH']
Code List: ["hasattr(L['a'], '_dynamo_dynamic_indices') == False"]
Object Weakref: <weakref at 0x7f2940229670; dead>
Guarded Class Weakref: <weakref at 0x7f29f4f93060; to 'torch._C._TensorMeta' at 0x5620fe8b6960 (Tensor)>
Guard 8:
Name: ''
Source: global
Create Function: GRAD_MODE
Guard Types: None
Code List: None
Object Weakref: None
Guarded Class Weakref: None
Guard 9:
Name: "L['b']"
Source: local
Create Function: TENSOR_MATCH
Guard Types: ['TENSOR_MATCH']
Code List: ["hasattr(L['b'], '_dynamo_dynamic_indices') == False"]
Object Weakref: <weakref at 0x7f28b35e3830; dead>
Guarded Class Weakref: <weakref at 0x7f29f4f93060; to 'torch._C._TensorMeta' at 0x5620fe8b6960 (Tensor)>
Guard 10:
Name: ''
Source: global
Create Function: DETERMINISTIC_ALGORITHMS
Guard Types: None
Code List: None
Object Weakref: None
Guarded Class Weakref: None
Guard 11:
Name: ''
Source: shape_env
Create Function: SHAPE_ENV
Guard Types: None
Code List: None
Object Weakref: None
Guarded Class Weakref: None
Guard 12:
Name: ''
Source: global
Create Function: TORCH_FUNCTION_STATE
Guard Types: None
Code List: None
Object Weakref: None
Guarded Class Weakref: None
Guard 13:
Name: "L['x']"
Source: local
Create Function: TENSOR_MATCH
Guard Types: ['TENSOR_MATCH']
Code List: ["hasattr(L['x'], '_dynamo_dynamic_indices') == False"]
Object Weakref: <weakref at 0x7f298f801350; dead>
Guarded Class Weakref: <weakref at 0x7f29f4f93060; to 'torch._C._TensorMeta' at 0x5620fe8b6960 (Tensor)>
Guard 14:
Name: ''
Source: global
Create Function: DEFAULT_DEVICE
Guard Types: ['DEFAULT_DEVICE']
Code List: ['utils_device.CURRENT_DEVICE == None']
Object Weakref: None
Guarded Class Weakref: None
Guard 15:
Name: ''
Source: global
Create Function: GRAD_MODE
Guard Types: None
Code List: None
Object Weakref: None
Guarded Class Weakref: None
Guard 16:
Name: "L['b']"
Source: local
Create Function: TENSOR_MATCH
Guard Types: ['TENSOR_MATCH']
Code List: ["hasattr(L['b'], '_dynamo_dynamic_indices') == False"]
Object Weakref: <weakref at 0x7f28b35e3830; dead>
Guarded Class Weakref: <weakref at 0x7f29f4f93060; to 'torch._C._TensorMeta' at 0x5620fe8b6960 (Tensor)>
Guard 17:
Name: ''
Source: global
Create Function: DETERMINISTIC_ALGORITHMS
Guard Types: None
Code List: None
Object Weakref: None
Guarded Class Weakref: None
Compile Times: TorchDynamo compilation metrics:
Function Runtimes (s)
------------------------------ --------------
_compile.compile_inner 0.0104, 0.0059
OutputGraph.call_user_compiler 0.0001, 0.0001
gc 0.0002, 0.0002
为了最大化加速效果，应尽量减少图断点。我们可以通过使用 fullgraph=True 强制 TorchDynamo 在遇到第一个图断点时报错。
opt_bar = torch.compile(bar, fullgraph=True)
try:
opt_bar(torch.randn(10), torch.randn(10))
except:
tb.print_exc()
class GraphModule(torch.nn.Module):
def forward(self, L_a_: "f32[10][1]cpu", L_b_: "f32[10][1]cpu"):
l_a_ = L_a_
l_b_ = L_b_
# File: /var/lib/workspace/intermediate_source/torch_compile_tutorial.py:535 in bar, code: x = a / (torch.abs(a) + 1)
abs_1: "f32[10][1]cpu" = torch.abs(l_a_)
add: "f32[10][1]cpu" = abs_1 + 1; abs_1 = None
x: "f32[10][1]cpu" = l_a_ / add; l_a_ = add = x = None
# File: /var/lib/workspace/intermediate_source/torch_compile_tutorial.py:536 in bar, code: if b.sum() < 0:
sum_1: "f32[][]cpu" = l_b_.sum(); l_b_ = None
lt: "b8[][]cpu" = sum_1 < 0; sum_1 = lt = None
Traceback (most recent call last):
File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 584, in <module>
opt_bar(torch.randn(10), torch.randn(10))
File "/var/lib/ci-user/.local/lib/python3.10/site-packages/torch/_dynamo/eval_frame.py", line 659, in _fn
raise e.with_traceback(None) from None
torch._dynamo.exc.Unsupported: Data-dependent branching
Explanation: Detected data-dependent branching (e.g. `if my_tensor.sum() > 0:`). Dynamo does not support tracing dynamic control flow.
Hint: This graph break is fundamental - it is unlikely that Dynamo will ever be able to trace through your code. Consider finding a workaround.
Hint: Use `torch.cond` to express dynamic control flow.
Developer debug context: attempted to jump with TensorVariable()
from user code:
File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 536, in bar
if b.sum() < 0:
Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo"
在下面，我们演示了 TorchDynamo 在上面用于演示加速效果的模型上没有中断图的捕获。
opt_model = torch.compile(init_model(), fullgraph=True)
print(opt_model(generate_data(16)[0]))
tensor([[ 0.1944, -0.1852, -0.0345, ..., -0.1099, -0.0875, -0.0556],
[ 0.2230, -0.2523, -0.0484, ..., -0.1007, -0.0564, 0.0947],
[ 0.1810, -0.1848, 0.0859, ..., -0.1820, -0.0490, 0.0786],
...,
[ 0.1163, -0.1853, 0.2045, ..., -0.1978, -0.0947, -0.0809],
[-0.0317, -0.2903, 0.0940, ..., 0.0461, -0.1323, 0.0095],
[ 0.2579, -0.0613, 0.0882, ..., -0.0969, -0.0555, -0.0583]],
device='cuda:0', grad_fn=<CompiledFunctionBackward>)
我们可以使用 torch.export（来自 PyTorch 2.1+）从输入的 PyTorch 程序中提取单个、可导出的 FX graph。导出的图旨在在不同的（即不依赖 Python 的）环境中运行。一个重要的限制是 torch.export 不支持图断点。请查看本教程以了解更多关于 torch.export 的详细信息。
